Accelerating Hyp’s Data Analytics Capabilities with AWS and DevOps Best Practices

Overview

Hyp is Israel’s leading tech-payment provider, delivering smart and flexible payment solutions for businesses of all sizes – from freelancers and small businesses to large enterprises, public organizations, and government entities. The company powers approximately one in three everyday payments in Israel and offers an advanced payment infrastructure for both online and point-of-sale transactions.
Its all-in-one platform includes payment pages, quick checkout options, anti-fraud measures, digital invoicing, seamless integrations with e-commerce platforms, and advanced point-of-sale solutions, including unattended products.
Hyp’s mission is to simplify the way businesses get paid, helping them manage transactions efficiently and focus on what really matters: their business.

In January 2022, Hyp completed a strategic merger of four veteran companies, each with its own well-established infrastructure. This consolidation enabled Hyp to expand its capabilities and offer a broader range of services under one roof. However, it also introduced a complex technological challenge: aggregating and managing data from multiple, previously siloed systems – including separate AWS accounts and on-premises environments.

To address this, Hyp set out to build a centralized, scalable database that would support fast data retrieval, deep analytics, and data-driven business decisions. The initiative also aimed to lay the groundwork for process automation and future AI-based tools to benefit both internal teams and customers.

To turn this vision into reality, Hyp required a secure, scalable, and fully automated Data Analytics infrastructure on AWS – one that would integrate seamlessly with its existing on-premises systems and support both current analytics needs and future innovations. Develeap and Nogamy were entrusted with the task of implementing the Data Analytics solution. Develeap, which has been Hyp’s DevOps team for over four years and continues to support them, was entrusted with the DevOps and cloud infrastructure setup, ensuring a robust, automated, and best-practice-driven AWS foundation for the Data Analytics initiative. Nogamy was entrusted with initiating developing and implementing the Data Analytics stack on top of this foundation. 

The Challenge

Before this project, Hyp had no existing Data Analytics infrastructure and operated with separate AWS accounts that were manually managed.

Business challenges:

• Millions of daily transactions
• Large-scale environment
• Unautomated data processing
• Lack of real-time insights

DevOps technological challenges:

• • Hybrid Cloud Integration: Establishing secure and stable connectivity between AWS and Hyp’s on-premises environment.
  • Multi-Account AWS Architecture: Designing and provisioning a centralized AWS Landing Zone aligned with best practices.
  • Security & Compliance: Ensuring proper IAM policies, secure networking, and data protection mechanisms.
  • Infrastructure Automation: Implementing Infrastructure as Code (IaC) with Terraform and Terragrunt to maintain a scalable and reproducible cloud environment.
  • Performance: creating a Data Analytics stack that will enable fast transport of data and fast retrieval of data analytics whilst handling huge volumes of data. Transport of 8-10 million transactions per day in 20 minutes. The total volume of data currently exceeds one billion.

• Cost driven Data Architecture: Choosing and customizing the solution that will enable transporting and manipulating huge amounts of data at reduced cost.

• Cost Optimization: Implementing automated scaling down of the provisioned resources in the environment, during non-operational hours to optimize costs and reduce unnecessary cloud expenditures.

The Solution: AWS-Powered DevOps Excellence

Phase 1: AWS Landing Zone Implementation

Develeap established a multi-account AWS environment using the AWS Landing Zone concept, ensuring secure account separation while maintaining centralized control. Key steps: 

1. AWS Organization Setup – Structured account hierarchy for management, BI, and cross-account access.
2. IAM & Access Controls – Defined IAM policies and roles to enforce least-privilege access.
3. Networking & Security – Configured VPC security, site-to-site VPN, and Transit Gateway for secure communication between AWS accounts and on-prem. 
4. Terraform & Terragrunt for IaC – Automated provisioning and configuration management using best practices in Infrastructure as Code. Built full automation through a CI process utilizing GitLab CI on a runner installed on an EC2 instance. The implementation follows the principle of least privilege, ensuring that the machine is granted only the minimum necessary permissions required for its operation.

Phase 2: Data Analytics Infrastructure Deployment

Once the AWS foundation was in place, Develeap provisioned the required infrastructure for Nogamy to create the Data Analytics array. This included a fine tuned AWS Glue solution of data transport, AWS Step Functions for orchestration, AWS S3 for raw data storage, AWS Redshift for Data Warehousing, AWS QuickSight for reporting, dashboarding and analysis.. The infrastructure was designed to allow Nogamy to efficiently build Data layers and processes with minimal effort, following best practices and maintaining all processes as Infrastructure as Code (IaC) that Develeap provisioned: 

1. Networking & Connectivity – Implemented AWS DirectConnect and VPN for a reliable hybrid cloud connection.
2. AWS Glue – Provisioned and configured AWS Glue for seamless ETL processing with access to both on-prem and AWS services.
3. Amazon S3 – Set up secure, cost-efficient storage for BI data lakes.
4. Amazon Redshift – Deployed and optimized a Redshift cluster (RA3.4xlarge) for high-performance data warehousing.
5. Secrets Management – Integrated AWS Secrets Manager for secure credentials handling.
6. Implementation of AWS Step Functions for ETL Automation – to further streamline the BI data pipeline, Develeap implemented AWS Step Functions to orchestrate and automate the ETL process. This approach ensured a seamless data ingestion and transformation workflow, reducing manual intervention and improving efficiency. The Step Functions workflow included the following key steps:
   1. Trigger Glue Crawler – Automatically initiates a Glue Crawler to fetch the data source metadata and schema, then inserts it into the Glue Catalog Database.
   2. Monitor Completion – The workflow waits until the Glue Crawler successfully finishes, ensuring the metadata is fully registered before proceeding.
   3. Trigger Glue Job – Once the crawler completes, a Glue Job is triggered to perform the ETL process on the data source, utilizing the catalog database to transform and prepare the data for analytics.
7. Quicksight Integration – Prepared the BI environment for future analytics with AWS Quicksight.

Overcoming Challenges: VPN Stability Issue

One of the key technical challenges was a stability issue with the VPN tunnel between AWS and Hyp’s on-premises environment. Develeap’s team conducted in-depth troubleshooting, leading to a successful resolution and ensuring stable hybrid cloud connectivity.

Impact & Results

Develeap’s AWS and DevOps expertise played a pivotal role in laying the foundation for Hyp’s Data Analytics-driven future. Key outcomes include: 

1. A fully automated, best-practice AWS environment using Terraform & Terragrunt.
2. Robust security architecture with IAM, VPC security, and Secrets Manager.
3. Seamless hybrid cloud connectivity between AWS and on-prem.
4. Optimized infrastructure for Data Analytics processes, setting the stage for analytics success.
5. Optimized cloud costs with automated scaling down during non-operational hours.

Business Outcomes & Value Delivered

Since the deployment of the Data Analytics infrastructure, Hyp has begun to realize significant business value across multiple levels of the organization:

• Unified, Trusted View of Operational Data
  For the first time, Hyp’s leadership, sales, operations,marketing and  finance teams now access consistent, validated, and up-to-date transaction data through unified dashboards. This has greatly improved cross-functional alignment and decision-making accuracy.
• Reduced Time to Insight Across the Organization
  With automated data ingestion, transformation, and visualization, the time required to generate key reports has been reduced from days to minutes. This agility allows teams to respond faster to market shifts, operational challenges, and regulatory requests.
• Empowered Data Consumers with Self-Service BI
  Business users across departments are now able to independently explore, analyze, and derive insights from the data using AWS QuickSight, reducing dependency on IT and helping more people in the organization work confidently with data.

Conclusion

By leveraging AWS best practices and DevOps automation, Develeap successfully transformed Hyp’s infrastructure – delivering a secure, scalable, and high-performing AWS environment ready to support their Data Analytics journey that was then delivered by Nogamy. This project eliminated the complexities of multi-account AWS management and ensured future scalability and operational efficiency for Hyp’s data-driven initiatives.