Autoposter
Can I emulate a sentient robot artist using AI + Instagram?
My 3d printer needed a personality. So I built this system to emulate a robot artist personality on an instagram account that can automatically post content and respond to instagram user comments.
The project result is shown at @autopot.ter. Definitely visit the instagram account for a better understanding of how this thing works. My text description below is lacking in examples..
Goal
The basic goal of the system is to present the 3d printer as a sentient robot artist.
The system has two primary components:
- Content generation: auto-generate instagram posts
- Instagram account control: Posting videos, and autoreplying to comments
The system automatically generates content from a catalog of existing images and videos of my art, then it manages instagram posts and comments from its personality.
System Flow Diagram:
The system has access to the following resources to use in content generation:
- Media Library:
- A collection of timelapse videos captured by the 3d printer
- Images and videos of Completed Works
- Build videos of the 3d printer being constructed
- System Instructions:
- Description of the media library’s contents and filenames
- JSON2Video Documentation and examples
- Instagram insights (new followers, post history, statistics)
- A Personality/History document of the 3d printer’s “personality”
Basic flow:
- Request most recent instagram insights
- Request list of media files from the media library
- Upload all resources to a GPT model
- Request a “social media post” from the gpt model based on the resources, and the personality document
- Parse the response, and upload the response to the json2video api
- Download the video from the json2video api
- Upload the video and it’s caption to instagram
Results:
The system is live and posting to the https://www.instagram.com/autopot.ter/ instagram account. The AI naturally figured out that, for some reason, viewers prefer videos of failed prints over successfull completions. It started posting exclusively failures for a while until I curtailed the behavior. That said, it is posting slightly more interesting content, but still struggles with in-vidoe label placement, and the personality isn’t well developed.
Autopotter Github Repository