Sungsu Lim


I am currently working as a data scientist at Tonal .

I have research experience in different areas of machine learning, including reinforcement learning and computer vision. I am interested in solving everyday challenges to make products and services more efficient. I believe technical skills to apply abstract knowledge to tackle real problems are becoming more crucial.

My life so far has been an interesting journey. Born and brought up in Korea, I was fortunate to have the opportunity to study in various countries including India, Hong Kong, U.S., and Canada. I have just entered the 2nd quarter of my life and I am eager to explore and discover what is out there in this world.

'In their hearts humans plan their course, but the Lord establishes their steps.' - Proverbs 16:9

Contact : sungsu_at_ualberta.ca

[Last updated: Oct 12, 2020]


Experience

Data Scientist

Tonal [link]
10.2020 - Present
Edmonton/Toronto, Canada

Research Assistant

University of Alberta
  • Research focus on control methods in reinforcement learning.
  • Developed a novel framework for using Q-learning in continuous action spaces.
  • Currently investigating different policy objectives and their optimization behaviors to improve policy gradient methods.
05.2018 - 09.2020
Edmonton, Canada

Associate Researcher, Reinforcement Learning

Huawei (Noah's Ark Lab) [link]
  • Worked on an applied project to increase automation efficiency using reinforcement learning (subject to NDA).
  • Developed deep continuous control models using PyTorch and Python3.
05.2019 - 08.2019 (3 mo.)
Edmonton, Canada

Software Engineer Intern, Machine Learning

Hive [link]
  • Developed face and logo detection/recognition models for providing comprehensive media analytics on celebrity/brand exposure across TV channels.
  • Worked on customizing deep learning models (Single-Shot Detector, faster R-CNN, R-FCN) and improving data preprocessing procedure using TensorFlow and Caffe.
05.2017 - 08.2017 (3 mo.)
San Francisco, U.S.

Research Intern, Computer Vision

SenseTime [link]
  • Worked for the research team at a unicorn startup developing core computer vision technologies for various clients around the world.
  • Worked on fast depth perception, computing 3D depth and its confidence map simultaneously from stereo images by extending traditional BRIEF feature descriptor to multi-scale.
  • Our method achieved 91% accuracy in the KITTI 2015 Stereo Dataset, and was delivered as a solution to run real-time on the CPU of a mobile phone.
06.2016 - 12.2016 (7 mo.)
Shatin, Hong Kong

Teaching Assistant

University of Alberta
  • CMPUT 174: Introduction to Foundations of Computing I (Fall 2017, Winter 2018)
  • CMPUT 397: Reinforcement Learning (Fall 2019)
09.2017 - 04.2018
09.2019 - 12.2019
Edmonton, Canada

Education

University of Alberta

PhD in Computing Science (Reinforcement Learning)
Advisor : Prof. Martha White and Prof. Adam White
Voluntary withdrawal to work more closely in the industry

09.2019 - 05.2020
Edmonton, Canada

University of Alberta

MSc (Research) in Computing Science (Reinforcement Learning)
Advisor : Prof. Martha White
Thesis : Actor-Expert: A Framework for using Q-learning in Continuous Action Spaces [paper]

09.2017 - 08.2019
Edmonton, Canada

The Hong Kong University of Science and Technology

BEng in Computer Science
Final Thesis Advisor : Prof. James Kwok
  • Graduated with First Class Honors
  • Study leave for mandatory military service in Korea (05.2013 - 02.2015, 21 mo.)
  • School of Engineering Student Ambassador (2012-2013)
  • Overseas Exchange Program (Northwestern University, Fall 2012)
09.2011 - 12.2016
Kowloon, Hong Kong

American Embassy School

IB Diploma
09.2009 - 05.2011
New Delhi, India

Publications and Preprints

  • Satsangi Y., Lim S. , Whiteson S., Oliehoek F., White M., Maximizing Information Gain in Partially Observable Environments via Prediction Rewards . Accepted to AAMAS, 2020.
    [paper]
  • Yasui N., Lim S. , Linke C., White A., White M., An Empirical and Conceptual Categorization of Value-based Exploration Methods . Accepted to Exploration in Reinforcement Learning Workshop. ICML, 2019
    [paper]
  • Lim S. , Joseph A., Le L., Pan Y., White M., Actor-Expert: A Framework for using Action-Value Methods in Continuous Action Spaces . Accepted to Deep Reinforcement Learning Workshop. NeurIPS, 2018
    [paper] [poster]
  • Lim S. , Tai Y., Ren J., Yan S., Liang Y., BRIEF Stereo: Fast Stereo Matching using Multiscale Binary Feature . Work done at SenseTime, 2016
    [paper]

Projects

RLControl: Collection of Reinforcement Learning Algorithms in Continuous Action Space

[code]

  • This repository contains various reinforcement learning algorithms, including value-based and policy gradient methods for continuous action spaces. This code base was also used for my Masters Thesis.

ArmStrong: Smart Coaching Mat with Real-time Feedback

[link]

  • Interdisciplinary Global Product Development project in collaboration with students from different universities in Hong Kong, Korea, and China.
  • The coaching mat keeps track of the number of push-ups and also gives feedback if the forces on the hands are uneven. The feedback is given through a mobile app connected via bluetooth.
  • Used Arduino with ultrasonic sensors, pressure sensors, and bluetooth module.

SmartWalk: Fall-detection Shoe for the Elderly

[link]

  • Summer Design Thinking project in collaboration with China Academy of Arts.
  • Based on the theme of 'the elderly', we developed a prototype shoe that detects if the wearer falls down and alerts family members.
  • Used Arduino with accelerometer and gyroscope.

Others

Church Organizing Committee and Treasurer

Antioch Church of Edmonton [link]
  • Organized church events and managed finance for the young adult group at the Antioch Church of Edmonton
01.2019 - Present
Edmonton, Canada

MOOC Course Developer

Coursera - Reinforcement Learning Specialization [link]
  • Developed programming assignments and quizzes for the online course
02.2019 - 09.2019
Edmonton, Canada