Cart-Pole Swing-Up & Balance, Sim-to-Real Ready
PPO balances 100% over 20 episodes, matching LQR; energy-pump swing-up catches the pole at 6.4 s. Trained in 1.5M steps, ~6 min CPU.
SHEET 01 / 07 · ROBOTICS / MECHATRONICS · ISO 2768-m
Mechanical engineering student working across RL-based control, machining dynamics & tool-condition monitoring, and validated simulation studies.
20 MSS VERIFIED MANUSCRIPTS · 2026
FIG. 1 — GRASHOF CRANK–ROCKER, COUPLER CURVE SHOWN DASHED · DIMS IN mm
PPO balances 100% over 20 episodes, matching LQR; energy-pump swing-up catches the pole at 6.4 s. Trained in 1.5M steps, ~6 min CPU.
End-to-end PPO swings up 20/20 and reaches upright in 0.71 s, 3x faster than a hand-tuned energy controller that managed 7/10 after five tuning rounds.
Energy swing-up 10/10; against a +0.8 rad/s body poke, PPO recovers 12/20 where the pure LQR loses all 20. Both balance 20/20 near upright.
PPO tracks velocity to 0.123 m/s mean error vs the LQR 0.163 m/s, ~25% tighter; the LQR is marginally more robust (20/20 vs 19/20).
Both PPO and LQR survive 20/20 and recover every shove; LQR holds station tighter (0.235 m vs 0.338 m), PPO settles faster in the demo (2.3 s vs 3.0 s).
BC-from-LQR warm start plus PPO holds 10/10 across ±30% magnet-constant drift where the LQR drops to 5/10; PPO-from-scratch failure documented.
Discrete PID tuned in Python (Kp12/Ki22/Kd1): 13% overshoot, 1.45 s settle, 0 steady-state error — firmware mirrors the sim 1:1.
Reverse-engineered retractable stair: parallel rails keep 6 treads level through a 900 mm rise; parametric FreeCAD macro poses the full fold live.
Self-directed (Daejeon target)
20 verified manuscripts across machining dynamics, tool-condition monitoring, and validated-analysis audits; all numbers reproduced from code.
Self-directed
Seven PPO-vs-LQR control studies (cart-pole through maglev and chatter suppression), each with a custom Gymnasium env and live demo.
⚙ Factory, Urgench
Hands-on CNC machining, CAM, drilling and metal cutting on the shop floor; sourced the cutting-parameter study access.
New Uzbekistan University
Focus on robotics, controls and manufacturing; graduating May 2027.
Orbit with mouse / touch.
⚙ Replace public/models/placeholder.glb with your own
SolidWorks / Fusion glTF exports — see README.
Fundamental mechanisms, drawn true to their kinematics. Hover, focus, or drag any figure to crank it by hand.
| DOMAIN | TOOL | LEVEL |
|---|---|---|
| CAD | SolidWorks · Fusion 360 | ●●●○ WORKING |
| MFG | CNC machining · 3D printing | ●●●● PRIMARY |
| CODE | Python · NumPy · SciPy | ●●●● PRIMARY |
| ML | Gymnasium · SB3 (PPO) · scikit-learn | ●●●○ WORKING |
| CONTROL | LQR · PID · energy methods | ●●●○ WORKING |
| SIM | FE & stability lobes (from scratch) | ●●●○ WORKING |
| DATA | pandas · matplotlib | ●●●○ WORKING |
| HW | Arduino · sensors | ●●○○ FAMILIAR |
A coupler-curve walking linkage — in the tradition of Chebyshev's 1878 plantigrade machine and Jansen's Strandbeest. Four crank-rocker legs share one crankshaft at staggered phase; each foot traces a curve with a flat stance stroke, so the frame walks. You found the undocumented sheet. Well played, engineer.