Data Science Infrastructure

About the client

Our client is a North American company that strives to revolutionize the way we think about food and health by leveraging deep research. To realize this bold vision, the customer applies cutting-edge data science & machine learning techniques powered by modern tools and cloud-native services to analyze the millions of molecules that exist across human food ration.

Challenge

The client needed to strengthen collaboration within the data scientists team by moving research capabilities into cloud workloads. Besides, they wanted to automate and unify the deployment process of AWS resources. That, in turn, would decrease the time and effort required for a team of data scientists to build and test their models.

Solution

Delivering the solution, the team used Terraform framework for infrastructure as a code implementation. Terraform code itself is stored in the GitLab repository, and the Terraform state – in the S3 bucket of the specific environment.

GitLab CI automation pipeline was used to enable the deployment of AWS resources on different environments. In turn, it allowed to do a one-click deployment of the AWS infrastructure to the development/production environment.

All the secrets are encrypted and securely stored on GitLab. GitLab CI provides customers with a single control point for the deployment process – for example, for reviewing Terraform code and deploying it on approving the merge request. It also enables control access in the AWS environment and restricts it for regular users, which means that all infrastructure changes can be deployed only with pipelines.

High-level solution diagram

ECS deployment example

Technologies

Terraform, AWS, GitLab CI, Amazon ECS, Amazon CloudWatch.

Result

The developed solution has allowed the client to use Terraform code and GitLab pipelines instead of manual AWS infrastructure and lambdas deployment. The data scientists team can now deploy AWS resources and test models in cloud workloads faster and more efficiently, which means they can focus on key scientific objectives rather than cloud engineering.

clients’ Success stories

Infrastructure & Devops Services for Fintech Product

The client experienced the need to automate the deployment process of microservices and simplify the release process. One of the requirements was to migrate Docker containers to AWS ECS and move existing infrastructure to Terraform.

View success story

Cloud & Devops Services for Cloud Native Product

The client had a manual multi-environment infrastructure deployment аnd no continuous integration & continuous deployment automation. That significantly impacted the speed of product development, release, and delivery cadence of new application versions in general. Besides, it required a considerable part of the development team capacity to process it manually.

View success story

Cloud & Devops Services for Real Estate Product

The client faced the need to automate multi-environment continuous integration and deployment process of microservices, move the front-end part to CDN as well as deploy multi-environment infrastructure as a code.

View success story

AWS Native Serverless Data & ML Pipelines Implementation

The client had high costs for development, deployment, and, most importantly, operation of the data platform including Data Lake, Ingestion, and ML Pipelines. The pipelines were mostly running in EC2 instances, which led to the increased cost of operations and required a significant amount of time to deploy and test the pipelines in lower environments.

View success story

Serverless Deployment Automation

The client came with a request to automate and unify the deployment process of serverless applications on AWS Lambda. Having manual deployments before, the customer was facing inconveniences and difficulties, including non-uniform environment setup (versions of Serverless, Python, Node, and so on were inconsistent) and inability to control the environment changes in one place.

View success story

CI/CD for Cross Platform Mobile Application

CI/CD (Continuous Integration/Continuous Deployment) offers a seamless bridge from development to deployment. Further, in the evolving world of mobile app development, efficiency and adaptability are key.

At Matoffo, we specialize in customizing CI/CD solutions that cater to cross-platform mobile application development. We focus on improving the technical workflow and enhancing our client’s overall business performance and user experience.

View success story

OUR FOCUS IS
CLOUD SOLUTIONS

Our primary goal is value delivery for the client by resolving technical challenges and assisting them to achieve their objectives. AWS cloud solutions are great toolset which we use to make it happens, primary by outstanding agility, where companies could scale up cloud resources as needed and significantly decrease time from idea to market as well as seamless adopt rapidly growing tech capabilities to transform their businesses to be competitive in the market.

Tell us about your business needs

    I agree to periodically receive relevant information, news, and event notifications from Matoffo.

    Our website uses cookies to help personalize content and provide the best browsing experience possible. To learn more about how we use cookies, please read our Privacy Policy.

    Ok