You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 15:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Thu Jun 25, 2026 12:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2372221060,2sleep20-21swapper/208:03:192
2372221060,2sleep20-21swapper/208:03:192
164312980,3sleep20-21swapper/207:43:212
164312980,3sleep20-21swapper/207:43:212
164312980,3sleep20-21swapper/207:43:212
190102840,3sleep20-21swapper/210:43:192
190102840,3sleep20-21swapper/210:43:192
302342640,2chrt30233-21users12:38:271
302342640,2chrt30233-21users12:38:271
302342640,2chrt30233-21users12:38:271
127392600,3chrt0-21swapper/007:33:220
127392600,3chrt0-21swapper/007:33:220
302132480,3chrt0-21swapper/209:48:152
302132480,3chrt0-21swapper/209:48:152
302132480,3chrt0-21swapper/209:48:152
80622460,1chrt6053-21kworker/u9:1-rpciod07:23:050
80622460,1chrt6053-21kworker/u9:1-rpciod07:23:050
302842440,4chrt0-21swapper/211:13:222
302842440,4chrt0-21swapper/211:13:222
302842440,4chrt0-21swapper/211:13:222
95092420,2sleep09513-21head07:23:250
95092420,2sleep09513-21head07:23:250
313792420,3sleep131384-21sed09:48:261
313792420,3sleep131384-21sed09:48:261
313792420,3sleep131384-21sed09:48:261
54192390,2sleep05421-21fschecks_time10:08:150
54192390,2sleep05421-21fschecks_time10:08:150
54192390,2sleep05421-21fschecks_time10:08:150
4528993730,5cyclictest545-21in:imuxsock11:48:031
4528993730,5cyclictest545-21in:imuxsock11:48:031
4525993729,6cyclictest32423-21threads11:18:240
4525993729,6cyclictest32423-21threads11:18:240
4525993729,6cyclictest32423-21threads11:18:240
4525993729,6cyclictest32423-21threads11:18:240
4525993629,5cyclictest1-21systemd07:48:210
4525993629,5cyclictest1-21systemd07:48:210
4525993629,5cyclictest1-21systemd07:48:210
4525993628,6cyclictest30919-21fschecks_time08:23:150
4525993628,6cyclictest30919-21fschecks_time08:23:150
145192360,2sleep114536-21tail07:38:181
145192360,2sleep114536-21tail07:38:181
310852350,1sleep131176-21/usr/sbin/munin08:23:171
310852350,1sleep131176-21/usr/sbin/munin08:23:171
107422340,2sleep110796-21users08:53:281
107422340,2sleep110796-21users08:53:281
107422340,2sleep110796-21users08:53:281
4528993327,4cyclictest20179-21/usr/sbin/munin10:48:261
4528993327,4cyclictest20179-21/usr/sbin/munin10:48:261
4528993327,4cyclictest20179-21/usr/sbin/munin10:48:261
220902330,3chrt0-21swapper/309:23:283
220902330,3chrt0-21swapper/309:23:283
129002330,2chrt0-21swapper/210:28:152
129002330,2chrt0-21swapper/210:28:152
4528993227,3cyclictest0-21swapper/109:43:041
4528993227,3cyclictest0-21swapper/109:43:041
4528993222,8cyclictest18849-21kernelversion10:43:171
4528993222,8cyclictest18849-21kernelversion10:43:171
4525993227,3cyclictest17406-21grep07:48:030
4525993227,3cyclictest17406-21grep07:48:030
4525993227,3cyclictest17406-21grep07:48:030
4525993226,4cyclictest26160-21tail11:03:170
4525993226,4cyclictest26160-21tail11:03:170
4525993218,12cyclictest0-21swapper/011:43:150
4525993218,12cyclictest0-21swapper/011:43:150
39912320,3sleep00-21swapper/011:28:270
39912320,3sleep00-21swapper/011:28:270
4525993127,3cyclictest21151-21tail09:23:170
4525993127,3cyclictest21151-21tail09:23:170
4525993117,12cyclictest550-21cron11:53:160
4525993117,12cyclictest550-21cron11:53:160
4525993117,12cyclictest550-21cron11:53:160
184822310,3sleep20-21swapper/209:15:232
184822310,3sleep20-21swapper/209:15:232
4528993023,5cyclictest16030-21sshd10:35:131
4528993023,5cyclictest16030-21sshd10:35:131
4525993025,4cyclictest30616-21latency_hist12:43:030
4525993025,4cyclictest30616-21latency_hist12:43:030
4525993025,4cyclictest30616-21latency_hist12:43:030
4525993025,3cyclictest4520-21cyclictest12:28:110
4525993025,3cyclictest4520-21cyclictest12:28:110
4525993025,3cyclictest22286-21fschecks_time10:53:150
4525993025,3cyclictest22286-21fschecks_time10:53:150
4525993023,5cyclictest14316-21threads09:03:250
4525993023,5cyclictest14316-21threads09:03:250
4528992923,4cyclictest21708-21gltestperf07:58:171
4528992923,4cyclictest21708-21gltestperf07:58:171
4528992922,5cyclictest30286-21ntp_offset11:13:221
4528992922,5cyclictest30286-21ntp_offset11:13:221
4528992922,5cyclictest30286-21ntp_offset11:13:221
4528992921,6cyclictest4335-21threads10:03:251
4528992921,6cyclictest4335-21threads10:03:251
4528992921,6cyclictest4335-21threads10:03:251
4528992921,6cyclictest18633-21threads07:48:241
4528992921,6cyclictest18633-21threads07:48:241
4528992921,6cyclictest18633-21threads07:48:241
4528992920,7cyclictest21820-21gltestperf12:18:171
4525992924,3cyclictest428-21gltestperf08:28:170
4525992924,3cyclictest428-21gltestperf08:28:170
4525992922,5cyclictest24111-21mailstats08:03:250
4525992922,5cyclictest24111-21mailstats08:03:250
4525992922,5cyclictest11564-21fschecks_count08:58:160
4525992922,5cyclictest11564-21fschecks_count08:58:160
4525992920,7cyclictest9217-21processes11:43:230
4525992920,7cyclictest9217-21processes11:43:230
4528992822,5cyclictest23161-21kernelversion09:28:191
4528992822,5cyclictest23161-21kernelversion09:28:191
4528992822,4cyclictest416-21gltestperf08:28:171
4528992822,4cyclictest416-21gltestperf08:28:171
4528992822,4cyclictest22750-21cpuspeed09:28:151
4528992822,4cyclictest0-21swapper/110:23:031
4528992822,4cyclictest0-21swapper/110:23:031
4528992822,4cyclictest0-21swapper/110:23:031
4528992822,3cyclictest0-21swapper/111:28:161
4528992822,3cyclictest0-21swapper/111:28:161
4528992821,5cyclictest20128-21kernelversion12:13:171
4528992820,6cyclictest24110-21cut10:58:171
4528992820,6cyclictest24110-21cut10:58:171
4528992820,6cyclictest24110-21cut10:58:171
4528992819,7cyclictest11376-21kernelversion10:23:191
4528992819,7cyclictest11376-21kernelversion10:23:191
4528992819,7cyclictest11376-21kernelversion10:23:191
4528992818,7cyclictest800-21latency_hist11:23:121
4528992818,7cyclictest800-21latency_hist11:23:121
4528992818,7cyclictest800-21latency_hist11:23:121
4528992818,7cyclictest800-21latency_hist11:23:121
4525992824,3cyclictest10638-21latency_hist10:23:030
4525992824,3cyclictest10638-21latency_hist10:23:030
4525992824,3cyclictest10638-21latency_hist10:23:030
4525992824,2cyclictest0-21swapper/012:03:030
4525992824,2cyclictest0-21swapper/012:03:030
4525992824,2cyclictest0-21swapper/012:03:030
4525992823,4cyclictest26721-21mailstats11:03:240
4525992823,4cyclictest26721-21mailstats11:03:240
4525992823,4cyclictest26721-21mailstats11:03:240
4525992823,3cyclictest20000-21latency_hist10:48:030
4525992823,3cyclictest20000-21latency_hist10:48:030
4525992822,4cyclictest1346-21avahi-daemon12:28:250
4525992822,4cyclictest1346-21avahi-daemon12:28:250
4525992822,4cyclictest1346-21avahi-daemon12:28:250
4525992821,5cyclictest7600-21sshd08:48:130
4525992821,5cyclictest7600-21sshd08:48:130
4525992821,5cyclictest17545-21latency_hist12:08:040
4525992821,5cyclictest17545-21latency_hist12:08:040
4525992820,6cyclictest22835-21cut09:28:170
4525992820,6cyclictest22835-21cut09:28:170
4525992818,8cyclictest20712-21kernelversion10:48:180
61222270,1chrt0-21swapper/010:08:230
61222270,1chrt0-21swapper/010:08:230
61222270,1chrt0-21swapper/010:08:230
61222270,1chrt0-21swapper/010:08:230
4528992722,4cyclictest14678-21systemd-journal12:36:131
4528992722,4cyclictest14678-21systemd-journal12:36:131
4528992722,4cyclictest14678-21systemd-journal12:36:131
4528992721,4cyclictest9358-21if_eth010:18:171
4528992721,4cyclictest9358-21if_eth010:18:171
4528992721,4cyclictest9358-21if_eth010:18:171
4528992721,4cyclictest1346-21avahi-daemon08:43:241
4528992721,4cyclictest1346-21avahi-daemon08:43:241
4528992720,5cyclictest4574-21/usr/sbin/munin11:33:151
4528992720,5cyclictest19411-21kernelversion09:18:181
4528992720,5cyclictest19411-21kernelversion09:18:181
4525992722,3cyclictest0-21swapper/010:53:180
4525992722,3cyclictest0-21swapper/010:53:180
4525992721,3cyclictest0-21swapper/010:59:560
4525992720,5cyclictest2732-21ntp_kernel_pll_08:33:210
4525992720,5cyclictest2732-21ntp_kernel_pll_08:33:210
4525992719,6cyclictest6207-21sshd11:37:140
4525992719,6cyclictest6207-21sshd11:37:140
452899263,3cyclictest290322sh09:43:231
452899263,3cyclictest290322sh09:43:231
452899263,3cyclictest290322sh09:43:231
4528992621,3cyclictest0-21swapper/108:33:211
4528992621,3cyclictest0-21swapper/108:33:211
4528992620,5cyclictest16255-21kernelversion07:43:191
4528992620,5cyclictest16255-21kernelversion07:43:191
4528992620,5cyclictest16255-21kernelversion07:43:191
4528992620,4cyclictest4520-21cyclictest12:18:271
4528992620,4cyclictest4520-21cyclictest12:18:271
4528992620,4cyclictest0-21swapper/108:18:191
4528992620,3cyclictest0-21swapper/109:13:241
4528992620,3cyclictest0-21swapper/109:13:241
4528992620,3cyclictest0-21swapper/107:23:031
4528992620,3cyclictest0-21swapper/107:23:031
4528992619,4cyclictest0-21swapper/111:08:221
4528992619,4cyclictest0-21swapper/111:08:221
4528992619,4cyclictest0-21swapper/111:08:221
4528992619,4cyclictest0-21swapper/108:48:261
4528992619,4cyclictest0-21swapper/108:48:261
4528992619,4cyclictest0-21swapper/108:48:261
4528992618,6cyclictest14155-21fschecks_count11:58:161
4525992621,3cyclictest741-21tail09:53:250
4525992621,3cyclictest741-21tail09:53:250
4525992621,3cyclictest741-21tail09:53:250
4525992621,3cyclictest741-21tail09:53:250
4525992621,3cyclictest6854-21cut11:38:160
4525992621,3cyclictest0-21swapper/009:53:180
4525992621,3cyclictest0-21swapper/009:53:180
4525992621,3cyclictest0-21swapper/009:53:180
4525992620,5cyclictest25336-21cut08:08:160
4525992620,5cyclictest25336-21cut08:08:160
4525992620,4cyclictest11909-21cron11:53:030
4525992620,4cyclictest11909-21cron11:53:030
4525992620,3cyclictest0-21swapper/007:38:220
4525992620,3cyclictest0-21swapper/007:38:220
4525992619,5cyclictest23701-21gltestperf12:23:170
4525992618,6cyclictest29087-21fschecks_time08:18:170
4528992521,3cyclictest1540-21grep11:23:211
4528992521,2cyclictest0-21swapper/112:08:161
4528992518,6cyclictest545-21in:imuxsock10:01:131
4528992518,6cyclictest545-21in:imuxsock10:01:131
4528992518,6cyclictest545-21in:imuxsock10:01:131
4528992518,5cyclictest26914-21latency_hist08:13:131
4528992518,5cyclictest26914-21latency_hist08:13:131
4528992517,7cyclictest12942-21switchtime07:33:241
4528992517,7cyclictest12942-21switchtime07:33:241
4528992511,12cyclictest14678-21systemd-journal11:03:191
4528992511,12cyclictest14678-21systemd-journal11:03:191
4528992511,12cyclictest14678-21systemd-journal11:03:191
4525992520,4cyclictest595-21sshd08:55:140
4525992520,4cyclictest595-21sshd08:55:140
4525992520,4cyclictest595-21sshd08:55:140
4525992520,3cyclictest0-21swapper/010:33:250
4525992520,3cyclictest0-21swapper/010:33:250
4525992519,4cyclictest0-21swapper/008:13:260
4525992519,4cyclictest0-21swapper/008:13:260
4525992519,3cyclictest0-21swapper/010:33:140
4525992519,3cyclictest0-21swapper/010:33:140
4525992517,6cyclictest4149-21gltestperf08:38:160
4525992517,6cyclictest12016-21cpuspeed07:33:140
4525992517,6cyclictest12016-21cpuspeed07:33:140
4525992517,5cyclictest0-21swapper/008:48:180
4525992517,5cyclictest0-21swapper/008:48:180
4525992517,5cyclictest0-21swapper/008:48:180
4525992516,7cyclictest2568-21latency_hist11:28:060
4525992516,7cyclictest2568-21latency_hist11:28:060
4525992516,7cyclictest2568-21latency_hist11:28:060
4525992515,8cyclictest23133-21cron12:23:030
4528992419,3cyclictest4520-21cyclictest08:08:041
4528992419,3cyclictest4520-21cyclictest08:08:041
4528992419,3cyclictest0-21swapper/109:56:541
4528992419,3cyclictest0-21swapper/109:56:541
4528992419,3cyclictest0-21swapper/109:56:541
4528992419,3cyclictest0-21swapper/109:56:541
4528992418,4cyclictest4520-21cyclictest10:13:201
4528992418,4cyclictest4520-21cyclictest10:13:201
4528992418,4cyclictest4520-21cyclictest10:13:201
4528992418,4cyclictest4520-21cyclictest10:13:201
4528992418,4cyclictest23093-21threads10:53:241
4528992418,4cyclictest23093-21threads10:53:241
4528992418,3cyclictest0-21swapper/112:33:131
4528992418,3cyclictest0-21swapper/112:33:131
4528992418,3cyclictest0-21swapper/112:33:131
4528992416,6cyclictest19995-21idleruntime12:13:161
4528992416,6cyclictest17710-21sshd12:08:131
452599242,11cyclictest18688-21cron09:18:030
452599242,11cyclictest18688-21cron09:18:030
4525992419,3cyclictest31186-21cron11:18:030
4525992419,3cyclictest31186-21cron11:18:030
4525992419,3cyclictest31186-21cron11:18:030
4525992419,3cyclictest0-21swapper/009:43:160
4525992419,3cyclictest0-21swapper/009:43:160
4525992419,3cyclictest0-21swapper/009:43:160
4525992418,4cyclictest29358-21idleruntime-cro11:13:040
4525992418,4cyclictest29358-21idleruntime-cro11:13:040
4525992418,4cyclictest29358-21idleruntime-cro11:13:040
4525992417,5cyclictest28743-21latency_hist12:38:170
4525992417,5cyclictest16180-21threads09:08:260
4525992417,5cyclictest16180-21threads09:08:260
4525992417,5cyclictest16180-21threads09:08:260
4525992417,4cyclictest0-21swapper/009:33:170
4525992417,4cyclictest0-21swapper/009:33:170
127882240,1chrt0-21swapper/111:53:211
127882240,1chrt0-21swapper/111:53:211
64172230,3sleep30-21swapper/308:43:203
64172230,3sleep30-21swapper/308:43:203
4528992319,3cyclictest25267-21ntp_offset09:33:221
4528992319,3cyclictest25267-21ntp_offset09:33:221
4528992318,4cyclictest749-21runrttasks10:28:551
4528992318,4cyclictest749-21runrttasks10:28:551
4528992318,3cyclictest4341-21kworker/u9:2-rpciod12:13:141
4528992318,3cyclictest0-21swapper/109:23:171
4528992318,3cyclictest0-21swapper/109:08:261
4528992318,3cyclictest0-21swapper/109:08:261
4528992318,3cyclictest0-21swapper/109:08:261
4528992316,6cyclictest5494-21rt-features11:33:241
4528992316,6cyclictest5494-21rt-features11:33:241
4528992316,5cyclictest0-21swapper/107:28:211
4528992316,5cyclictest0-21swapper/107:28:211
4528992315,6cyclictest6994-21cut11:38:181
4528992315,6cyclictest6994-21cut11:38:181
4528992315,6cyclictest6994-21cut11:38:181
4528992313,8cyclictest14316-21threads09:03:251
4528992313,8cyclictest14316-21threads09:03:251
4525992319,3cyclictest3079-21latency_hist10:03:200
4525992319,3cyclictest3079-21latency_hist10:03:200
4525992319,2cyclictest0-21swapper/007:53:170
4525992319,2cyclictest0-21swapper/007:53:170
4525992319,2cyclictest0-21swapper/007:53:170
4525992317,5cyclictest19194-21cut09:18:160
4525992317,5cyclictest19194-21cut09:18:160
4525992317,4cyclictest0-21swapper/007:58:160
4525992317,4cyclictest0-21swapper/007:58:160
4525992317,3cyclictest0-21swapper/009:38:240
4525992317,3cyclictest0-21swapper/009:38:240
4525992316,5cyclictest0-21swapper/010:28:150
4525992316,5cyclictest0-21swapper/010:28:150
145062230,3sleep20-21swapper/210:33:102
145062230,3sleep20-21swapper/210:33:102
4536992217,3cyclictest22332sleep209:58:242
4536992217,3cyclictest22332sleep209:58:242
4536992217,3cyclictest22332sleep209:58:242
4528992218,3cyclictest4238-21head08:38:161
4525992217,3cyclictest2415-21switchtime09:58:260
4525992217,3cyclictest0-21swapper/010:23:190
4525992217,3cyclictest0-21swapper/010:13:260
4525992217,3cyclictest0-21swapper/010:13:260
4525992217,3cyclictest0-21swapper/010:13:260
311772220,4sleep20-21swapper/208:23:172
311772220,4sleep20-21swapper/208:23:172
4549992116,3cyclictest168152chrt07:43:263
4549992116,3cyclictest168152chrt07:43:263
4549992116,3cyclictest168152chrt07:43:263
4528992117,3cyclictest4520-21cyclictest07:53:151
4528992117,3cyclictest4520-21cyclictest07:53:151
4528992117,3cyclictest4520-21cyclictest07:53:151
4528992116,3cyclictest0-21swapper/111:33:051
4528992116,3cyclictest0-21swapper/107:23:251
4528992116,3cyclictest0-21swapper/107:23:251
4528992114,4cyclictest0-21swapper/108:58:181
4528992114,4cyclictest0-21swapper/108:58:181
452899211,11cyclictest15206-21unixbench_multi11:58:271
452899211,11cyclictest15206-21unixbench_multi11:58:271
452899211,11cyclictest15206-21unixbench_multi11:58:271
4525992115,3cyclictest0-21swapper/010:38:240
4525992115,3cyclictest0-21swapper/010:38:240
452899209,9cyclictest14678-21systemd-journal08:18:031
452899209,9cyclictest14678-21systemd-journal08:18:031
4528992015,3cyclictest0-21swapper/110:38:161
4528992015,3cyclictest0-21swapper/110:38:161
4525992016,2cyclictest0-21swapper/012:08:240
4525992016,2cyclictest0-21swapper/012:08:240
452599201,15cyclictest20716-21ls12:13:250
452599201,15cyclictest20716-21ls12:13:250
4528991914,3cyclictest0-21swapper/111:48:181
4528991914,3cyclictest0-21swapper/111:48:181
4525991913,5cyclictest28743-21latency_hist12:38:050
4525991913,5cyclictest28743-21latency_hist12:38:050
454999181,12cyclictest17670-21chrt09:13:193
454999181,12cyclictest17670-21chrt09:13:193
452899181,15cyclictest24012-21ls12:23:191
452899181,15cyclictest24012-21ls12:23:191
4549991712,3cyclictest268712sleep312:32:593
4549991712,3cyclictest268712sleep312:32:593
4549991712,3cyclictest268712sleep312:32:593
454999171,12cyclictest29388-21chrt11:13:063
454999171,12cyclictest29388-21chrt11:13:063
454999171,12cyclictest29388-21chrt11:13:063
454999171,12cyclictest25195-21chrt08:08:143
454999171,11cyclictest7091-21taskset07:18:213
454999171,11cyclictest7091-21taskset07:18:213
454999171,11cyclictest3670-21taskset08:38:053
454999171,11cyclictest3670-21taskset08:38:053
454999171,11cyclictest27842-21taskset08:13:253
454999171,11cyclictest27842-21taskset08:13:253
454999171,11cyclictest18506-21chrt12:08:223
454999171,11cyclictest18506-21chrt12:08:223
454999171,11cyclictest17153-21chrt09:13:153
454999171,11cyclictest17153-21chrt09:13:153
454999171,11cyclictest0-21swapper/309:03:163
454999171,11cyclictest0-21swapper/309:03:163
453699174,5cyclictest0-21swapper/209:03:132
453699174,5cyclictest0-21swapper/209:03:132
453699171,13cyclictest9833-21chrt07:27:132
453699171,13cyclictest9833-21chrt07:27:132
453699171,11cyclictest4527-21chrt11:33:122
453699171,11cyclictest4527-21chrt11:33:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional