Web3D webinar this Tuesday, Steam Deck test, documentation updates, PasVulkan tests

Posted on

Unholy Society using CGE running on Steam Deck

This weekend news post will cover a few things πŸ™‚

  1. I will give a talk about X3D, X3D 4, PBR (Physically-based Rendering), and how it connects with glTF 2.0 and Castle Game Engine this Tuesday, 29th March. Head on to the Web3D site to register, the talk is free and open to join for everyone. Plan of the talk is here.

  2. Thanks to Liam Dawe from Gaming On Linux, we have The Unholy Society, developed entirely in Castle Game Engine, running on Steam Deck! See the photo.

  3. I was testing PasVulkan on my Linux system.

    This was in preparation for working on Vulkan renderer for CGE. While we don’t plan to add Vulkan support for CGE in 7.0 release, but it is something I definitely want to start in 2022. So I wanted to test and see how PasVulkan works, and we’ll likely use the Vulkan header from PasVulkan: src/Vulkan.pas.

    I made it work on Linux. If anyone else on Linux wants to try — my PR that adds necessary script for Linux is here. It should of course work on Windows too, out of the box.

  4. Documentation:

    1. Improved (updated various tasks, clearer list) the roadmap page

    2. Added 2 sections to the Coding Conventions:

      1. Fix warnings (let the compiler help you write reliable code),
      2. Backward compatibility is important; having a consistent (easy to learn) API and useful features is even more important.
    3. Improved (simplified, updated) the macOS page.

Comments on the forum ➀

New Castle Tester – running all engine automatic tests on all platforms (desktop, mobile, Nintendo Switch…) with all compilers (FPC, Delphi)

Posted on

Castle Game Engine Automatic Tests

This screenshot will not win the #screenshotsaturday hashtag, but it took a lot of effort to achieve πŸ™‚

Thanks to Andrzej KilijaΕ„ski we have a big upgrade to our automatic tests application, available as always in tests/ subdirectory of CGE. Instead of using FpcUnit, the application can now use our own testing framework CastleTester that

  1. Is deliberately very compatible with FpcUnit (in fact, using some of its code).

  2. Tightly integrated with CGE, providing easy UI using CGE to run and display all tests results, and some extra utilities like CreateWindowForTest.

  3. Compiles and runs with both FPC and Delphi. All our tests now pass with both compilers. We made a number of fixes to Delphi support thanks to this (FPC support was being tested and flawless since a long time).

  4. Compiles and runs for all platforms we support. E.g. you can run the testsuite on Android, iOS, Nintendo Switch this way, by building the castle-tester for these platforms — just like any other CGE application.

As always, both Jenkins and GitHub Actions run all these tests automatically after every push. Jenkins even runs them with both FPC and Delphi 11.

Comments on the forum ➀

Mirrored Repeat mode, TextureProperties.BoundaryModeS/T/R support

Posted on

TextureProperties on 3D texture
TextureProperties - various boundary modes, including mirrored repeat
  1. Thanks to Matthias (Free Pascal meets SDL) we now support “mirrored repeat” mode for textures, for both glTF and X3D models. We also support X3D TTexturePropertiesNode.BoundaryModeS/T/R properties, which allow to request a wrapping mode — clamp, repeat, or mirrored repeat. (see TBoundaryMode)

    The way you would request it in Pascal is by creating and adjusting TTexturePropertiesNode like this:

    TextureProperties := TTexturePropertiesNode.Create;
    TextureProperties.BoundaryModeS := bmMirroredRepeat;
    TextureProperties.BoundaryModeT := bmMirroredRepeat;
    MyImageTexture.TextureProperties := TextureProperties;
    

    You can experiment with the example code that builds a mesh using Pascal to add there TextureProperties as above.

    Example X3D file utilizing it is in demo-models, file texturing_advanced/texture_boundary_modes.x3dv.

    Example glTF file using this is in Khronos glTF-Sample-Models, open glTF or GLB in dir 2.0/TextureSettingsTest.

  2. Another related fix is that we fixed the default values of TTexturePropertiesNode.MinificationFilter, TTexturePropertiesNode.MagnificationFilter. By default, they now indicate to use minification/magnification specified in MyScene.RenderOptions, which means that merely adding a TTexturePropertiesNode doesn’t make the filtering uglier. This was fixed in X3D 4.0 some time ago (after my request) and CGE now follows, so we have a saner default.

The documentation about TextureProperties node was extended to mention it all.

Comments on the forum ➀

Creating Debian Packages with Castle Game Engine build tool

Posted on

cge+debian

Debian is a popular Linux distribution, also serving as a base for other Debian-based distributions like Ubuntu. You can now easily create a Debian package, .deb file, from any game!

  • From Castle Game Engine Editor use menu option Run -> Package Format -> Debian Package (DEB) and then Run -> Package.

  • Or use command-line build tool with --package-format=deb option. The full command may look like this:

    castle-engine package --package-format=deb --fast
    

To install the resulting package using command-line you can execute sudo apt install ./xxx.deb. Once installed, you can see it in all applications listing currently-installed packages (like Synaptic). You can remove the package using e.g. Synaptic or just sudo apt purge xxx.

While it will work out-of-the-box, to have a really good package you should make sure you filled some information in the project manifest:

  1. Be sure to specify the project author

  2. Specify an icon, in XPM or PNG formats.

  3. Specify sections, categories and comment to have the package and application look best.

This feature was mostly developed by Eugene Loza (thousand thanks!) with some additions from Michalis. It’s not a secret that we’re both using Debian OS as the main operating system and as such most of CGE was probably created on Debian or Debian-derivatives πŸ™‚ So we’re very happy with this integration.

Comments on the forum ➀

GitHub Actions

Posted on

GitHub Actions
GitHub Actions

We now use GitHub Actions to automatically test and build CGE, in addition to our existing CI with Jenkins.

The main advantage of GitHub Actions for us, from a high-level view, is that they are more friendly to new contributors.

  1. They work in every fork (even before you do any pull pequest) automatically.

    Jenkins, OTOH, only processes the main repository and PRs to it. Jenkins doesn’t even know about a fork if you don’t ever make a PR.

  2. You will see GitHub Actions execution for each commit, nicely presented in GitHub UI. E.g. if you do PR, and you break compilation with some particular FPC version, you will immediately see which FPC version was broken by this commit (detailed logs are also available).

    This was also true for Jenkins, but the GH Actions results just look immediately more informative, with a breakdown into which job failed. In case of Jenkins, you got short information that a job failed, and you needed access to our Jenkins to see all the details why it failed.

  3. Execution of all GH Actions (workflows, that in turn contain jobs) is also publicly visible.

The instructions what to do after each push are in .github/workflows/test-and-pack.yml in repo. This is somewhat equivalent to the Jenkins instructions in Jenkinsfile. You can all see them and propose edits to them.

Our workflow uses the same Docker image as our Jenkins to have the same environment for builds.

We also experimented with setup-lazarus-environment action on plain Ubuntu image — and it worked mighty fine, it was trivial to run a GH Action using FPC/Lazarus on plain Ubuntu without having any custom Docker image. Still, we’d need to extend that “plain Ubuntu” with some tools we need for some automatic CGE tests, and in the end (esp. since as our Docker image is useful for other purposes too, like interactive building and Jenkins) it was easier to just use our Docker image in GH Actions.

To be clear, we still also use our beloved Jenkins, but we’re just exploring an alternative.

  • Jenkins still gives us ultimate control over the whole process — configuration on master, ability to setup slaves in any way we like (we right now have Linux, Windows, Raspberry Pi slaves, and will soon resume macOS slave thanks to macStadium). E.g. it’s not a problem to have Windows slave with Delphi 11 Enterprise installled, or Raspberry Pi slave.

  • It remains to be seen how much of it is worth “switching over” to GH Actions and how much should remain on Jenkins in the foreseeable future. I know that you can run GH workflows on self-hosted machines, but I suspect with this comes both the trouble and the power inherent in the fact that you maintain these machines, their resources like CPU and disk space, yourself. So for now, at least most GH workflows will be on GH-hosted servers, and we shall see how much this is really problematic to us and how much we enjoy it.

  • There’s also a question of “money and control”, unrelated to the technical superiority of this or that solution. GH Actions are free for open-source projects (but the infrastructure is closed and depends on GitHub). Jenkins servers require maintenance (which I usually enjoy) and have a cost (paid by my company Cat-astrophe Games which shares some of the Jenkins infrastructure), OTOH Jenkins remains open-source and under our control forever.

  • Well, for now I’m just having fun with more automation tools :), and just experimenting.

Comments on the forum ➀

Summary of 1st open meeting: things in-progress, upcoming planned features, next meeting

Posted on

Upcoming physics as behaviors

Thank you all for today’s meeting!

I think it went good, my only regret is that we want to have more participants! To facilitate this, I’m immediately announcing the next meeting, 3 months from now. Reserve the date! πŸ™‚ Join our Discord right now and click “I’m interested” on the “2nd Open Meeting for CGE Users and Developers“.

Summary:

Things in progress:

  1. light-components branch by Michalis, with lights (point, spot, directional) as components that you can visually add/modify in CGE editor; also more flexibility where lights are cast and received; also Phong shading by default, and limit of lights per shape increased to 64.

  2. physics branch by Andrzej KilijaΕ„ski, with colliders and rigid body components as behaviors, that you can add and adjust in CGE editor; also auto-size by default for colliders.

  3. Testing GitHub Actions as another CI tool, in addition to our existing Jenkins.

Next plans:

  1. Camera and navigation: a few inter-connected new features: 1. camera visible in viewport, 2. design-time and runtime camera and navigation separate, 3. navigate on right-click, like in other game engines (Unity, Unreal).

  2. fps_game – AI using behaviors. Setup whole FPS game in editor. light-components branch actually already has example design how it would look like.

  3. Publish CGE as a tool on Steam.

  4. Assign and override materials in CGE editor.

  5. CGE 7.0-alpha.2 release ASAP, CGE 7.0 in 2022!

Comments on the forum (2) ➀

Reminder: Open meeting for all CGE Users and Developers today

Posted on

Lights editing

As announced previously, we’ll have a meeting today, and everyone is invited!

Join Michalis Kamburelis and other Castle Game Engine developers, contributors and users.

The meeting will happen at 16:00 (UTC timezone) on Saturday, 5th March.

Meeting will be on our Discord channel #open_meeting.

Please keep your mic muted when you’re not speaking, to avoid the noise πŸ™‚

Comments on the forum ➀

Various: RemoveDelayed utility, using fcl-res instead of windres tool, MultiTexture features

Posted on

Multi-texturing in X3D
  1. New utility TCastleTransform.RemoveDelayed to remove TCastleTransform but not immediately. This is great if you need to remove some TCastleTransform from children list, but you also iterate over the children list right now.

  2. We no longer use windres utility, instead we generate Windows resources in memory using FPC’s units from fcl-res package.

    Our build tool now uses fcl-res units to actually build a resource file in memory, and write the resulting RES file. This means we can write the Windows RES file without the help of any external tool, and without creating some intermediate/temporary RC/manifest files. Everything happens in memory, in a cross-platform way.

    This is nicer for people with Delphi, who want to compile applications without the need to download windres from FPC/MinGW/MSys.

    This is also nicer for people doing cross-compilation from e.g. Linux to Windows. Previously this required Linux version of windres, which needed installation of MinGW binutils on Linux. Now this utility is not necessary.

  3. MultiTexture features are now restored in shader renderer. All models from demo-models/multi_texturing and described on our X3D multi-texturing page now work with latest CGE and view3dscene.

Comments on the forum ➀

Mobile improvements: optimizations on Aarch64, texture compression fixes, GameAnalytics SDK updated

Posted on

Retro Phone by Marek Picheta
β€œPhone booth” by YJ
  1. Long time ago, we had to disable optimizations with FPC on Aarch64 (64-bit Arm) as they were too unstable. But were happy to revert this πŸ™‚ With FPC >= 3.2.2, optimizations on Aarch64 work flawlessly, and so we enable them. This affects Android, iOS and macOS Silicon targets.

    The optimizations will remain disabled if the build tool detects you’re using FPC 3.2.0 and compile to Aarch64. You will see appropriate warning about it in the output. For this reason, we recommend that you upgrade to the latest stable FPC, 3.2.2.

  2. Fix to usage of Compressonator on Linux: detect also lowercase compressonatorcli executable, following new Compressonator file naming in Linux.

  3. Fix to usage of PVRTexTool. We adjusted compression format names to follow latest naming from PVRTexTool Command Line Options.

  4. GameAnalytics SDK usage on Android upgraded to 6.2.6.

Continuing the recent trend of using “just a screenshot of CGE rendering some nice glTF model when I have no better idea for a news image” here are 2 renderings of phones. “Retro Phone” (Sketchfab) by Marek Picheta is licensed under Creative Commons Attribution. “Phone booth” (Sketchfab) by YJ is licensed under Creative Commons Attribution as well.

Comments on the forum ➀

Open Meeting for CGE Users and Developers

Posted on

fps_game with lights using CGE editor

I wrote this announcement a ~week ago, which feels like ancient times now. Since then, Russia attacked Ukraine. Right now bombs are falling on the heads of people in Ukraine, including people who use and develop CGE, including my friends and their families. I feel terrified, outraged and powerless — this horrible thing just happened, just because some murderous madman in Russia decided to play war.

We already announced this meeting earlier on Discord, and I propose we go ahead and try to do this meeting on 5th March… and hope the world will be at a better place, not worse, by then. I will let you know if we decide to reschedule.

Let’s meet and talk! Join Michalis Kamburelis and other Castle Game Engine developers, contributors and users.

The meeting will happen at 16:00 (UTC timezone) on Saturday, 5th March.

Meeting will be on our Discord channel #open_meeting.

Please keep your mic muted when you’re not speaking, to avoid the noise πŸ™‚

More details what can happen:

Many factors tell me that meeting together would be great πŸ™‚ It will be a great way to ask and answer “live” some CGE questions. It will be a great way to showcase what I’m working on. And I want to invite everyone else to showcase what you are working on too! I hope to make this a 2-way show, in which everyone interested has time to take the stage and show whatever (s)he wants, ask any questions etc.

Comments on the forum (2) ➀