You can just copy over the Library folder, that should do it. Then set up the plex Docker to use bind mounts instead of volumes and place your old library into that bind mount.
I usually do ~/docker/plex/Library
and have the Docker compose file in the ~/docker/plex
folder