Data Engineer
Navigos Group
Thoả thuậnĐăng ngày: 9 ngày trước
Navigos Group
Build and maintain the data pipelines and warehouse (DWH on ClickHouse) that power analytics and reporting across Vietnamworks/microsites. Ingest and integrate data from operational and CRM databases (MySQL/PostgreSQL/MongoDB; publish/subscribe integration, stored procedures) and product analytics (PostHog). Keep data reliable, fresh and well-modeled; provide light database administration (performance tuning; ensure and test backup/restore); build reports and standardized metrics; and support business and product teams with trusted data and optimized queries.
1. Data Pipelines, Warehouse & Quality: Build and run ELT pipelines (dbt (data build tool), orchestrated by Prefect) from operational sources (MySQL, PostgreSQL, MongoDB, Elasticsearch) and product analytics (PostHog) into the data warehouse (DWH on ClickHouse); model data and tune query performance. Run automated data tests (dbt tests); monitor freshness and schema drift; own data SLAs and handle data incidents.
2. Databases & Administration (DBA scope): Manage operational and CRM databases (MySQL/PostgreSQL/MongoDB), including a publish/subscribe (pub/sub) model and stored procedures. Handle performance and index tuning; ensure and test backup/restore and recovery. Heavy infrastructure operations and on-call sit with DevOps/Infra.
3. Reporting & Insight: Build reports and dashboards (Metabase) and standardize core metrics so teams share one definition. Turn business questions into trusted analysis and insight for product and business decisions, using product analytics (PostHog).
4. Data Support & Query Optimization: Handle data tickets and ad-hoc requests from business and product teams; write, review and optimize SQL (performance tuning).
5. Security, Privacy & Compliance: Role-based access (RBAC), PII masking/encryption and audit logging; data retention and erasure. Controls to support Decree 13/2023/ND-CP, with Legal/DPO.
COMPETENCIES/SKILLS: