DATA SCIENCE INFRASTRUCTURE

About the client

Our client is a North American company that strives to revolutionize the way we think about food and health by leveraging deep research. To realize this bold vision, the customer applies cutting-edge data science & machine learning techniques powered by modern tools and cloud-native services to analyze the millions of molecules that exist across human food ration.

Challenge

The client needed to strengthen collaboration within the data scientists team by moving research capabilities into cloud workloads. Besides, they wanted to automate and unify the deployment process of AWS resources. That, in turn, would decrease the time and effort required for a team of data scientists to build and test their models.

Solution

Delivering the solution, the team used Terraform framework for infrastructure as a code implementation. Terraform code itself is stored in the GitLab repository, and the Terraform state – in the S3 bucket of the specific environment.

GitLab CI automation pipeline was used to enable the deployment of AWS resources on different environments. In turn, it allowed to do a one-click deployment of the AWS infrastructure to the development/production environment.

All the secrets are encrypted and securely stored on GitLab. GitLab CI provides customers with a single control point for the deployment process – for example, for reviewing Terraform code and deploying it on approving the merge request. It also enables control access in the AWS environment and restricts it for regular users, which means that all infrastructure changes can be deployed only with pipelines.

High-level solution diagram

ECS deployment example

Technologies

Terraform, AWS, GitLab CI, Amazon ECS, Amazon CloudWatch.

Result

The developed solution has allowed the client to use Terraform code and GitLab pipelines instead of manual AWS infrastructure and lambdas deployment. The data scientists team can now deploy AWS resources and test models in cloud workloads faster and more efficiently, which means they can focus on key scientific objectives rather than cloud engineering.

clients’ Success stories

INFRASTRUCTURE & DEVOPS SERVICES FOR FINTECH PRODUCT

The client experienced the need to automate the deployment process of microservices and simplify the release process. One of the requirements was to migrate Docker containers to AWS ECS and move existing infrastructure to Terraform.

View success story

CLOUD & DEVOPS SERVICES FOR CLOUD NATIVE PRODUCT

The client had a manual multi-environment infrastructure deployment аnd no continuous integration & continuous deployment automation. That significantly impacted the speed of product development, release, and delivery cadence of new application versions in general. Besides, it required a considerable part of the development team capacity to process it manually.

View success story

CLOUD & DEVOPS SERVICES FOR REAL ESTATE PRODUCT

The client faced the need to automate multi-environment continuous integration and deployment process of microservices, move the front-end part to CDN as well as deploy multi-environment infrastructure as a code.

View success story

SERVERLESS DATA & ML PIPELINES

The client had high costs for development, deployment, and, most importantly, operation of the data platform including Data Lake, Ingestion, and ML Pipelines. The pipelines were mostly running in EC2 instances, which led to the increased cost of operations and required a significant amount of time to deploy and test the pipelines in lower environments.

View success story

SERVERLESS DEPLOYMENT AUTOMATION

The client came with a request to automate and unify the deployment process of serverless applications on AWS Lambda. Having manual deployments before, the customer was facing inconveniences and difficulties, including non-uniform environment setup (versions of Serverless, Python, Node, and so on were inconsistent) and inability to control the environment changes in one place.

View success story

CI/CD FOR MOBILE CROSS PLATFORM APPLICATION

Initially, the client’s development team performed continuous integration and continuous deployment processes manually. Consequently, it was time- and effort-consuming to build cross-platform mobile applications. Besides, they used the legacy tools stack – that doesn’t have built-in mobile-specific continuous integration and deployment capabilities.

View success story

SERHII YELCHENKO

Delivery Director

We are cloud native company who visions cloud computing as the home for tech products. Our team of top-notch engineers specialize in Cloud solutions, we develop scalable cloud native applications, provide DevOps services which facilitate innovations and allow release products faster, build reliable and secure cloud infrastructure for our clients from the US and Europe.

Tell us about your business needs

    I agree to periodically receive relevant information, news, and event notifications from Matoffo.

    Our website uses cookies to help personalize content and provide the best browsing experience possible. To learn more about how we use cookies, please read our Privacy Policy.

    Ok