1K Views
October 29, 24
スライド概要
TIER IV Data Platform Team
Data Team
Table of Contents 01 About Our Team 02 Data Overview 03 Data Services 04 Appendix
About Our Team 01
TIER IV Accelerating System Development Through Data Sharing The Data Team is building the foundations for accelerated development of autonomous driving systems by enhancing data sharing. The team is creating an environment that collates logs generated by autonomous driving systems, enabling developers to quickly locate and utilize the data they need. Data Platform Team
TIER IV Team Objectives Develop data collection pipelines and facilitate precise data extraction with advanced search capabilities. Simplify search and visualization to ensure quick and accurate access to desired data. Maintain high standards of safety in data provision.
TIER IV Culture Innovative: We leverage web technologies to build necessary tools and pipelines for collecting and searching data. Proactive: We embody the vision essential for the foundation of autonomous driving that accelerates system development through data sharing. Communication-focused: We are continuously attuned to the needs of developers, engaging in dialogue, and crafting effective features collaboratively.
Data Overview 02
TIER IV Web.Auto Overview SIMULATION Build CI/CD PIPELINE Recreate real-world events from autonomous driving logs, run scenario-based simulations, and test-drive vehicles with virtual sensors. Development A cloud platform and tools for editing scenarios and maps enable extensive testing through autonomous driving software builds and simulations. Test Dataset, ML Models Maps, Scenarios Autonomous Driving Dev. Cycle Vehicle Data Firmware Images FLEET MANAGEMENT Management and scheduling of autonomous vehicles, data analysis, and OTA updates. Data Collection DATA MANAGEMENT Efficient data collection from autonomous vehicles, and data retrieval for learning and testing purposes. Deployment Operation Data Platform Team REMOTE OPERATION Remote driving and monitoring of vehicle status.
TIER IV Data Workflow Data Collection Data Processing Data Analysis Autonomous Driving Software Development Data Upload Tool Business BI Tool Mobility Observer Linkage Data Search Export Aggregation Telemetry Datawarehouse Vehicle Events Raw log Vehicle Metrics Data Platform Team
TIER IV Data/ML Components Operator FMS Data/ML Services Data Collection Data Platform Data Processing Vehicle Telemetry Data Log File (rosbag etc) t4dataset Annotation Integration BI Tool Mobility Observer ML Model Training Pipeline Annotation Tool Data/ML User (Autonomous Driving Developer) Data Platform Team CI/CD Pipeline Evaluator Scope of development Control lines Out of scope Data lines
TIER IV Data/ML Workflow & Teams Data Collection Data Processing Data Labeling Model Development Data Engineers Model Deployment Model Monitoring MLOps Engineers Data/ML Team FMS/Drive Team System Integration Team Sensing/Perception Team Data Platform Team CI/CD Team
Data Services 03
TIER IV Data Services Data collection Data collection/processing pipeline Data Collection Freshness, completeness, validity ... Time series data storage selection Scalability, operability, serviceability … Mobility observation Data collaboration pipeline Mobility Observation Variety, quality …. Autonomous Driving Software Development Data search engine selection Searchability, accuracy … Data visualization Display geographic/time series data, videos, images … Data Platform Team
TIER IV Data Pipeline System Architecture Telemetry Upload Row Data Metrics Streaming Log Record Upload Event Data Data Saerch Log File Upload Data Upload Tool Log File Metadata Data Platform Team
TIER IV Technology Stack Backend Go Infrastructure Frontend Python TypeScript CI/CD React Logging/Monitoring Datadog Data Platform Team Sentry GitHub Actions
TIER IV CONTACT US https://careers.tier4.jp/ THANKS AGAIN ! Data Platform Team
Appendix 04
TIER IV Mobility Obserever Data Platform Team