Data Architect Internship

Overview: Data Strategy and Governance The Data Architect is responsible for designing and governing the end-to-end data landscape of our integrated supply chain e-commerce platform. You will create comprehensive data models, establish robust ETL pipelines to unify data from core systems (MES, WMS, OMS), and architect the infrastructure for real-time analytics, ensuring strict compliance with data privacy regulations like GDPR. Internship Details Duration: 3 months Start Date: Immediate Location: Remote Stipend: None initially. Based on your first-quarter performance, you may be offered a paid full-time opportunity, or even be absorbed directly by the client as an FTE. Key Responsibilities & Core Projects You will transform raw system data into a structured asset, supporting both operational efficiency and business intelligence. • Data Modeling & Design: Design and maintain comprehensive conceptual, logical, and physical data models for all data domains: e-commerce transactions, customer behavior, internal tool usage, and supply chain records. • Data Integration (ETL): Architect and implement scalable ETL/ELT pipelines to efficiently aggregate, transform, and load data from disparate sources, including PostgreSQL 15 (MES, WMS, OMS modules) and internal applications. • Data Governance & Compliance: Define and enforce data governance policies, focusing heavily on GDPR compliance, data privacy, access control, and data quality standards. • Analytics Infrastructure: Design and implement the infrastructure for real-time analytics and business intelligence, ensuring data is readily available and optimized for consumption by reporting tools and the Analytics/BI module. • Retention & Archival: Define and plan data retention, archiving, and purging strategies, ensuring long-term data management efficiency and compliance. • Database Optimization: Collaborate with SRE and development teams to optimize database schemas and queries for both high transactional throughput and analytical reporting performance. Required Technologies & Tools Candidates must possess deep experience in data modeling, integration, and governance across diverse systems: • Database Mastery: Expert proficiency in PostgreSQL 15 (schema design, performance tuning, RLS principles) and caching technologies (Redis). • Data Warehousing/ETL: Proven experience designing and implementing scalable data pipelines and data warehouse structures. • Programming/Scripting: Proficiency in scripting for data transformation and pipeline automation (e.g., Python, SQL). • Compliance: Mandatory experience implementing controls for GDPR and other data privacy regulations. • Search/Storage: Familiarity with data usage in Meilisearch and object storage systems (MinIO). AI Agent Focus You will structure the data assets required to power and train our AI layer. • Data for LLMs: Architect the data flow and preparation layer that provides clean, contextually relevant data for LLM fine-tuning, prompt engineering, and Retrieval Augmented Generation (RAG) processes. • Interaction Modeling: Design models to capture and track AI agent interactions and outcomes for auditing, performance analysis, and continuous improvement of the multi-agent system. Success Metrics & Career Path Performance will be measured by: • Data Accuracy/Quality: Measurable improvement in the quality, consistency, and reliability of data used for analytics. • Pipeline Efficiency: Speed, stability, and latency of ETL pipelines supporting real-time analytics requirements. • Compliance Audit: Successful implementation and auditing of data governance and GDPR policies. Mentorship Structure: Reports to the Solution Architect or Head of Technology, working closely with the Analytics/BI, Security, and Core Module development teams. Originally posted on Himalayas