AI DevOps & Infrastructure
XTrace: Serverless API transition to GPU-enabled ECS infrastructure
"Tech 42 successfully executed a seamless migration of our serverless API to a GPU-enabled ECS infrastructure while preserving our complex encryption workflows. This transition significantly enhanced our system's scalability and reduced operational latency. Since implementation, the system has demonstrated exceptional stability with zero downtime incidents. This reliable performance has freed our engineering team to concentrate on core business initiatives rather than infrastructure management.
We are highly satisfied with Tech 42's technical expertise and project execution. Based on this positive experience, we would confidently engage Tech 42 for future technology partnerships."
Liwen Ouyang
Co-founder
Project summary
XTrace's privacy-preserving vector database relied on partially homomorphic encryption to enable secure similarity searches. Their Lambda-based architecture hit a limit: the 15-minute timeout constraint made it impossible to run complex encryption operations at scale. Tech 42 migrated their serverless system to AWS ECS, containerized their existing encryption workflows in Docker, and deployed GPU-accelerated instances for compute-intensive operations. The new architecture includes a FastAPI framework with authentication, auto-scaling capabilities, and comprehensive testing. XTrace now runs a scalable confidential computing platform that maintains strict data privacy while handling workloads that serverless could not support. The system has delivered zero downtime incidents since deployment and reduced operational latency, allowing the engineering team to focus on product development rather than infrastructure management.
