This page details how installing software/homebrew works on the 3DS.
3DS software formats
Software on the 3DS comes in two main formats: CIA and 3DSX.
CIA (.cia) format software is usually installed with FBI and will end up on HOME Menu as a launchable title. Both homebrew and retail game dumps are available in the CIA format.
3DSX (.3dsx) format software is installed by placing the 3DSX file in the "3ds" (NOT Nintendo 3DS) folder and can only be launched from Homebrew Launcher. All 3DSX format software is homebrew.
No format is inherently better than the other; it just depends on how you want to launch your software. If you'd prefer your application on HOME Menu, CIA format is the way to go. Otherwise, 3DSX is probably better.
There is also NDS (.nds) format software, which can only be used with TWiLightMenu++/nds-bootstrap and can be installed by placing the NDS file anywhere on the SD card visible to TWiLightMenu++. This format of homebrew is also compatible with the DSi and with DS flashcarts.
Some other file formats you might encounter (but not as often):
3DS (.3ds) is used for cartridge dumps, which you can make/install using GodMode9. This file format is also often used with Citra.
CXI (.cxi) is a generic executable format sometimes used for digital file dumps / preservation.
APP (.app) is the packed application format that you will see in the Nintendo 3DS folder. You won't be able to directly manipulate these very easily.
In summary, if you want to install software on your 3DS, you should be looking for CIA or 3DSX format applications — and sometimes NDS files.
There is 3 software that can be used to install 3DS software:
FBI is an application that can install CIA files. To use it:
Place your .cia file anywhere on your SD card. (You may want to create a "cias" folder for organizational purposes.)
Open the FBI application (if you followed 3ds.hacks.guide, it will be on your HOME Menu)
Navigate to SD Card -> (wherever you put the .cia file)
Navigate to Install and delete CIA
The CIA file itself does not need to be kept after it is installed, hence "install and delete"
Wait for the CIA to install
Once the install has finished, close FBI and the application should appear as a gift box to open on your HOME Menu. If it doesn't immediately appear, you may have to power your console off and on to get it to appear.
GodMode9 is an application that can install CIA files. To use it:
Place your .cia file anywhere on your SD card. (You may want to create a "cias" folder for organizational purposes.)
Power on your 3DS while holding Start
Navigate to [0:] SDCARD and press A
Navigate to the location of the .cia file you want to install, then press A
Navigate to CIA Image Options... and press A
Navigate to Install game image and press A
Unlock write permissions if prompted
Wait for the CIA to install
Press A when Install success appears
Relock write permissions if prompted
Once the install has finished, reboot your console by pressing Start
Running .3dsx files
To run a piece of homebrew in .3dsx format:
Place your .3dsx file in the 3ds folder (NOT Nintendo 3DS) on your SD card
Some pieces of homebrew may require additional support files. You may have to consult the README / documentation of that software if this is the case
The homebrew should now appear when you open the Homebrew Launcher (the blue "h" icon) on your HOME Menu
Navigate between homebrew applications / folders using the D-Pad and press the A button to launch it
Using Universal-Updater
If you followed 3ds.hacks.guide to install custom firmware on your 3DS, you probably also have Universal-Updater, which can be used as a homebrew app store. To use it:
Open the Universal-Updater application (the blue down arrow icon)
Use the D-Pad to navigate between applications and the (A) button to select an application
Use the "Search" or "Filter" function (the magnifying glass) to look for a specific application
Under "Available Downloads", select either the CIA, 3DSX, or NDS file, then press (A) again to install the application
Check the queue (the button with the number in it) to see download progress
CIA files will appear on your HOME Menu in a gift box after you exit Universal-Updater
3DSX files will become available in the Homebrew Launcher application