Wasp Summer School 2023

1 Jun 2023 — 1 Sep 2023

About

The WASP Summer School Synthesis of Human Communication 2023 was a networking event organized by Wallenberg AI, Autonomous Systems and Software Program. It took place in Norrköping, Sweden, between 21-Aug-2022 and 25-Aug-2022.

Speakers from industrial and academic backgrounds were invited to present their work to attendees, while PhD students were tasked with completing an assignment on the topic of generative AI, to earn credits towards their degrees.

The summer school was rounded off in the Norrköping Visualisation Center 3D dome, in which 3D video demos showcasing the students’ submissions were presented.

Responsibilities

Teaching & Organization:

  • Write a technical gesture generation tutorial with student exercises.
  • Give a technical presentation on the PhD student assignment.
  • Present a tutorial on mapping speech audio to gestures.
  • Mentor students during the completion of their assignment.
  • Organize and coordinate the collection of assignment submissions.
  • Plan the testing of hardware and software in the Norrköping Visualisation Center 3D dome.
  • Formulate technical and organizational questions for collecting student feedback.

Technical:

  • Develop a complete web application with a browser front-end and Python back-end.
    • Celery for task scheduling.
    • FastAPI for exposing a REST API over HTTP.
    • Uvicorn for launching a web server.
    • Javascript for handling API communication and front-end updates.
    • CSS and HTML for front-end design.
    • Docker (compose) for decoupling app modules and managing deployment.
    • Git for version control (repo link).
  • Deploy the web application on 2 remote Linux servers using Docker.
  • Monitor web server resources over SSH.
  • Monitor and ensure web application availability over SSH.
  • Use Blender with Python scripts to visualize BVH data and convert it to FBX.
  • Produce 5 cinematics in Unreal Engine 4.27 from FBX data, in collaboration with Mihail Tsakov.
  • Build an nDisplay project (UE4.27) and test it in the Norrköping Visualisation Center 3D dome.
  • Maintain a Git repository with instructions for the student assignment.

For technical details, check the gesgen web application Git repo.