# Subsetra Ark — Modern Test Data Management (TDM) & Privacy Platform

> Subsetra Ark is a developer-first, enterprise Test Data Management (TDM) and privacy platform. It automates sensitive PII discovery, intelligent data masking, referential integrity database subsetting, snapshot-based data virtualization, and ephemeral test database provisioning directly inside your customer VPC.

## Overview & Core Identity
Subsetra Ark solves the test data bottleneck for modern engineering, QA, DevOps, and compliance teams. Traditional Test Data Management relies on multi-terabyte staging environments, manual SQL masking scripts, or cloud tools that require uploading production data to external SaaS vendors. Subsetra Ark runs an outbound-only, zero-inbound mTLS agent inside the customer's private network (VPC/on-premise), ensuring that sensitive data never leaves your infrastructure while delivering safe, production-like test databases to developers and CI/CD pipelines in seconds.

## Core Capabilities
- [Database Subsetting](https://subsetra.com/docs#subsetting): Relational, foreign-key aware, cyclic-safe database extraction with configurable sample rates and deterministic business-object filters.
- [Data Discovery & PII Classification](https://subsetra.com/docs#classification): Multi-pipeline scanning (schema heuristics, DeID patterns, HuggingFace embeddings, local Ollama LLMs) with automated drift detection and reclassification.
- [Deterministic Scenario Anchors](https://subsetra.com/docs#anchors): Version-controlled, parameterized SQL test fixtures executed after subsetting for reproducible QA and end-to-end integration test scenarios.
- [Data Virtualization & Golden Snapshots](https://subsetra.com/docs#virtualization): Versioned baseline snapshots with copy-on-write cloning for instantaneous test environment reset and branching.
- [Ephemeral Test Database Provisioning](https://subsetra.com/docs#ephemeral): On-demand MySQL and PostgreSQL Docker sandboxes with automated TTL expiration and CI/CD CLI integrations.
- [In-VPC Synthetic Data Generation](https://subsetra.com/docs#synthetic): Native Go-powered synthetic row generation running entirely in-cluster without sending schema or data to 3rd-party APIs.

## Architecture & Security Boundary
- **Control Plane (Ark SaaS or Self-Hosted)**: Manages governance metadata, user roles, masking configurations, and job orchestration. Never accesses raw database rows.
- **Data Plane (ark-agent in Customer VPC)**: Deployed as a lightweight Go binary inside customer infrastructure. Establishes an outbound-only mTLS gRPC connection. Executes extraction, masking, subsetting, and ephemeral sandbox creation locally.
- **Data Privacy & Compliance**: Built for GDPR, KVKK, CCPA, SOC 2, and HIPAA environments. Provides tamper-evident hash-chained audit logs with WORM S3/MinIO exports.

## Developer & DevOps Tooling
- [ark-cli](https://subsetra.com/docs#cli): Command-line tool to trigger classification, manage configs, and provision ephemeral test environments with `--wait` flags for CI/CD pipelines.
- [ark-sdk-go](https://subsetra.com/docs#sdk): Official Go SDK for embedding Ark test data lifecycle management into custom internal developer portals.
- [ark-sdk-js](https://subsetra.com/docs#sdk): Official JavaScript/TypeScript SDK for Node.js workflows and Playwright/Jest integration test setups.

## Feature & Architecture Comparison
- [Ark vs Other TDM Platforms](https://subsetra.com/compare): Side-by-side comparison across PII discovery, referential subsetting, in-VPC agent architecture, synthetic data, and developer experience.

## Documentation & Guides
- [Getting Started / Pilot Guide](https://subsetra.com/get-started): Step-by-step instructions to register a source database, deploy `ark-agent`, and provision your first masked sandbox.
- [Technical Documentation](https://subsetra.com/docs): Full system reference covering the control plane, agent deployment, governance workflows, and CLI/SDK guides.
- [Interactive UI Demo](https://subsetra.com/demo): Visual walkthrough of classification reports, masking policy rules, and test environment provisioning.

## Articles & Engineering Deep Dives
- [Ark Anchors™: Start Every Test from a Known State](https://subsetra.com/blog/ark-anchors-deterministic-test-scenarios): How reusable, version-pinned SQL fixtures make subsetted and ephemeral test databases deterministic across CI, QA, and demos.
- [Business Objects: Give Test Data a Business Shape](https://subsetra.com/blog/business-objects-for-repeatable-test-data): How Ark Business Objects turn customer, order, claim, and other domain concepts into reusable, governed data subsets.
- [Stop Waiting Hours for Database Restores: Ark Data Virtualization](https://subsetra.com/blog/stop-waiting-hours-for-database-restores): Freeze trusted database baselines and spin up disposable clones in seconds. No drift, no storage bloat, all inside your VPC.
- [Data Virtualization for Test Data: Fast, Repeatable, and Safer Lower Environments](https://subsetra.com/blog/data-virtualization-for-test-data): Ark brings data virtualization to lower environments by letting teams freeze a trusted database state and provision repeatable clones for QA, CI, demos, and developer workflows.
- [Where Should the Model Sit? Local AI for PII Classification Without New Egress](https://subsetra.com/blog/local-ai-pii-classification): Cloud LLMs speed up data classification — and create a new path for sensitive context to leave the network. Here is why in-network AI assist is becoming the durable pattern for privacy and test-data workflows.
- [Testing with Real Databases: Why Mocks Lie, How Top Teams Test, and the Rise of Ephemeral DBs](https://subsetra.com/blog/ephemeral-database-testing-strategies): Discover why unit test mocks and in-memory databases fail to catch production errors, how industry-leading teams execute real HTTP-to-database integration tests, and how Subsentra Ark makes ephemeral test databases instant, safe, and referentially intact.
- [From Zero to Query: How to Provision a Production-Like Development Database in Seconds](https://subsetra.com/blog/instant-local-dev-database): Static seed files lie, shared staging breaks, and full production dumps crush developer laptops. Here is how graph-aware subsetting, automatic VPC masking, and Ark CLI deliver safe, production-like ephemeral databases in seconds without storing data on local laptops.
- [Stop Cloning Production. Start Sampling It.](https://subsetra.com/blog/subset-vs-full-replica): A full masked replica is still the wrong answer. Why a referentially intact, masked subset is what your tests actually need — and how to ask for the smallest slice that still works.
- [Why Test Databases Exist — And Why Shared Staging Quietly Fails](https://subsetra.com/blog/why-test-databases-exist): Shared staging cannot keep up with CI, parallel teams, and privacy law. Here is what test databases are for, where teams go wrong, and what a production-like, masked, ephemeral approach looks like.

## Canonical Links & Contact
- Website: https://subsetra.com
- Documentation: https://subsetra.com/docs
- Comparison Matrix: https://subsetra.com/compare
- Contact: info@subsetra.com
- Full LLM Context: https://subsetra.com/llms-full.txt