Gem installation problem.

[Neluser]

@girish I noticed that the path has changed in the new version.
Before update

after update

[girish]

Alright, I am back on this case now. It seems I have re-learn how ruby/gems are deployed each time I investigate this. So, I will leave some notes this time around to help us all later.

[girish]

OK, I think I figured this one out.

Just leaving my notes here, since I will surely need this few months from now

RubyGems

RubyGems is the package manager and the names of packages is gems. RubyGems is part of ruby since 1.9. The gem CLI lets one install gems. list, info, search install are common subcommands.

By default, gem install requires sudo since into installs into system location /var/lib/gems/2.7.0. It will also install deps of the gem. App can require these gems in code.

Bundler

Bundle(r) allows an app to specify a Gemfile that lists the gems and it's versions. bundle install will install the gems into the same system wide location. bundle exec command runs the executable command in context of the bundle. Meaning, it will ensure that the app does not use any gems not listed in the bundle and also ensure that the gems it is using are compatible with the versions in the Gemfile.

bundler creates Gemfile.lock with "resolved" versions. This has to be writable file even at runtime.

Gem install

• gem - GEM_HOME defines where gems are installed. GEM_PATH is list of search locations for gems. This is at the kernel level. Default value of these variables can be got from gem env gemhome and gem env gempath. GEM_HOME is implicitly included into GEM_PATH.

• bundler - by default, it's tuned for development and uses gem defaults underneath. This means everything is installing into system locations. bundler has a deployment mode which is a shortcut for installing into vendor/bundle subdirectory (--local will write to <project_root>/.bundle/config and --global will write to ~/.bundle/config). When you call bundle install --deployment first time, it stashes this path info into .bundle/config and all subsequent calls follow this "deployment" mode. In deployment mode, gems will only get loaded from the vendor directory and nowhere else. (As an aside, BUNDLE_PATH env var can be set to tell bundler where to install and locate gems).

Gem loading

Ruby kernel is just loading gems based on LOAD_PATH variable. bundle exec is essentially overloading require calls. It reads Gemfile.lock, patching LOAD_PATH to have paths of the gems and then calling the original kernel require.

[girish]

OK, next part of notes is how things relate to Redmine package.

Current state:

• Redmine is installed into /app/code
• gems needed by redmine are installed by calling bundle in deployment mode. This means gems are installed into /app/code/vendor/bundle. The bundle calls creates a .bundle/config to remember deployment mode.
• We set BUNDLE_PATH env var to /app/data/vendor/bundle. The intention here is that when the user calls cd plugindir && bundle install, the gems needed by the plugin will get installed into /app/data/vendor/bundle. This works as expected. (We set env var because the .bundle/config won't be found after the cd).
• For gem loading to work, GEM_PATH is set to /app/data/vendor/bundle with the intention that bundler exec will use it . But as read in the notes above, the whole point of deployment mode is to only load gems from the path in .bundle/config. This means that gems required by plugins will never be loaded. This is obvious now... we cannot have gems in two locations in deployment mode.

This used to work because this commit switched to deployment mode without understanding the consequences.

The fix:

• Install gems needed by redmine into system locations (so developer mode and not deployment mode)
• Set GEM_HOME as /app/data/vendor/bundle. This way bundle install inside plugin directory will install there.
• Loading also works fine because GEM_HOME is implicitly added into GEM_PATH.

[girish]

@Neluser When you have the time, can you please try with the latest package? (You can ignore all my notes!) https://docs.cloudron.io/apps/redmine/#installing-plugins is pretty much the same.

[girish]

In a plot twist worth of O. Henry novel... I went back to using deployment mode. There were two reasons:

• Upstream plugin docs like the redmine up plugins recommend running bundle install at the top level.

• Using development mode means having to edit a plugin's Gemfile and add source line to make bundle install work.

I fixed the package to now have the bundle in /run/redmine/vendor instead. It's just copied over on startup, it greatly simplifies things.

[Neluser]

@girish
Hi! The latest version of Redmine is working!
A clean install works as it should!
Updating Redmine from 1.6 to 1.9 also works. The only thing I had to manually delete the "Bundle" folder And after that everything worked as it should.

Thank you for your hard work!

[girish]

@neluser said in Gem installation problem.:

The only thing I had to manually delete the "Bundle" folder And after that everything worked as it should.

whoops, that is a package bug. I will fix it.