August 2025: Infrastructure & Platform Enhancements

The August 2025 release deploys a series of backend improvements to Data Lake Sync focused on performance, scalability, and long-term maintainability. These changes help lay the foundation for upcoming product features while improving system reliability today.

Logging Architecture Overhaul
Log events were previously written to a centralized logging database and file store. Logging will now be stored in AWS S3 and retrievable from the Data Lake Sync Portal. This change improves log retention, speeds up log analysis, and reduces load on the core application database.

Improved Connection Handling
We’ve enhanced the way Data Lake Sync manages connectivity to both source and destination systems, with improved backing off algorithms and error handling. This results in better resilience to intermittent network issues and faster recovery from connection interruptions.

Removal of API Call Counting Process
The legacy process for counting Infor API calls has been removed. This reduces application overhead and simplifies internal data processing. The existing API call count was an estimate only and not used by customers. 

Migration to pyodbc for SQL Server
We’ve replaced the previous SQL Server connector (pymssql) with pyodbc. This offers better compatibility with modern SQL Server drivers, and enhanced support for enterprise authentication methods.

Docker-Based Deployment Architecture
Data Lake Sync is now containerized using Docker. This enables better scalability, more consistent environment management, and improved deployment flexibility across development and production environments.

CI/CD and Testing Enhancements
Our continuous integration and deployment pipelines have been upgraded to support faster, more reliable deployments. Automated testing coverage has also been expanded to provide reduced risk during releases.

If you have any questions about these changes or encounter any issues, please contact our support team.