AI Technical Expert (LLM / Vision / Real-time Streaming)
Lingkar Solusi · JAKARTA BARAT, DKI JAKARTA, ID
Sekilas tentang pekerjaan ini
Lingkar Solusi mencari AI Technical Expert untuk menghadirkan kemampuan AI siap produksi bagi produk B2G AI dan dashboard insights. Peran ini memimpin implementasi dari desain hingga operasi di lingkungan teregulasi, berkolaborasi dengan tim engineering, DevOps/SRE, dan keamanan, serta berlokasi di Jakarta Barat.
Tugas utama
- Menerapkan dan mengoperasikan LLM di server GPU, termasuk penyetelan performa dan pemantauan.
- Membangun layanan model vLLM dan API aman dengan observabilitas.
- Menerapkan pipeline RAG serta melakukan fine-tuning atau adaptasi model.
- Membangun pipeline suara real-time dengan ASR dan integrasi TTS.
- Mengembangkan streaming video dan computer vision untuk menghasilkan data dashboard.
Kualifikasi utama
- Kemampuan mengoperasikan LLM inference pada GPU on-prem atau private cloud.
- Pemahaman vLLM, REST/gRPC, autentikasi, audit log, dan observabilitas.
- Kemampuan mendukung NVIDIA GPU serta Huawei/Ascend GPU/NPU.
- Pemahaman RAG, embeddings, vector search, dan evaluasi model.
- Kemampuan menangani streaming ASR/TTS dan computer vision real-time.
Ringkasan ini dibuat dengan AI dari deskripsi di bawah. Yang berlaku adalah deskripsi lengkapnya di situs Lingkar Solusi.
Deskripsi pekerjaan
We are hiring an AI Technical Expert (LLM / Computer Vision / Real-time Streaming) to deliver production-grade AI capabilities for B2G AI and dashboard insights products. You will lead implementation from solution design to deployment and operations in regulated environments (data residency, auditability, controlled rollout), working closely with engineering, DevOps/SRE, and security teams.
Responsibilities
- Install, deploy, and operate LLM inference on GPU servers (on-prem/private cloud), including performance tuning, scaling strategy, monitoring, and rollback/versioning.
- Deploy and operate model serving using vLLM (and other serving stacks where appropriate), exposing secure APIs (REST/gRPC) with authentication, rate limits, audit logs, and observability.
- Support heterogeneous infrastructure: deploy LLM workloads across NVIDIA GPU (x64) and Huawei/Ascend GPU/NPU (ARM64) environments, including containerization, drivers/runtime, and compatible serving/inference stacks.
- Implement RAG / retrieval pipelines (ingestion, chunking, embeddings, vector search) and evaluation gates for quality and safety.
- Perform fine-tuning/adaptation when required (LoRA/QLoRA preferred): dataset preparation (incl. de-identification), experiment tracking, and acceptance reporting.
- Build real-time voice pipelines: live audio ingest, streaming ASR, optional diarization, and TTS integration with low latency.
- Build real-time video streaming + computer vision: ingest (RTSP/WebRTC/SRT/HLS as needed), transcoding, GPU inference (detection/tracking/event detection), and structured event outputs for dashboards.
- Deliver production readiness: runbooks, incident playbooks, DR/backup validation, security hardening, and go-live support.