You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 17:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Fri Jul 17, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1378721230,2sleep10-21swapper/111:53:261
1378721230,2sleep10-21swapper/111:53:261
2160721190,2sleep16526-21cyclictest07:53:391
2160721190,2sleep16526-21cyclictest07:53:391
26892980,3chrt2694-21cpu11:23:351
26892980,3chrt2694-21cpu11:23:351
26892980,3chrt2694-21cpu11:23:351
247612800,2sleep124762-21cat08:03:241
247612800,2sleep124762-21cat08:03:241
37792660,3chrt0-21swapper/208:33:362
37792660,3chrt0-21swapper/208:33:362
221942570,2chrt0-21swapper/112:13:441
221942570,2chrt0-21swapper/112:13:441
221942570,2chrt0-21swapper/112:13:441
221942570,2chrt0-21swapper/112:13:441
303902550,2sleep20-21swapper/211:08:452
303902550,2sleep20-21swapper/211:08:452
163572550,2chrt16355-21ntp_states07:38:431
163572550,2chrt16355-21ntp_states07:38:431
163572550,2chrt16355-21ntp_states07:38:431
80932530,3sleep20-21swapper/210:08:472
80932530,3sleep20-21swapper/210:08:472
285242510,2sleep10-21swapper/111:03:451
285242510,2sleep10-21swapper/111:03:451
285242510,2sleep10-21swapper/111:03:451
57502500,2chrt0-21swapper/111:28:461
57502500,2chrt0-21swapper/111:28:461
57502500,2chrt0-21swapper/111:28:461
108652490,5sleep110863-21gzip11:43:411
108652490,5sleep110863-21gzip11:43:411
108652490,5sleep110863-21gzip11:43:411
252012460,2sleep10-21swapper/109:28:421
252012460,2sleep10-21swapper/109:28:421
252012460,2sleep10-21swapper/109:28:421
173232460,3sleep20-21swapper/207:43:282
173232460,3sleep20-21swapper/207:43:282
173232460,3sleep20-21swapper/207:43:282
270992450,3sleep1271rcuc/112:28:361
270992450,3sleep1271rcuc/112:28:361
270992450,3sleep1271rcuc/112:28:361
53702420,1sleep15371-21fschecks_time10:03:351
53702420,1sleep15371-21fschecks_time10:03:351
28792420,2sleep1271rcuc/109:56:521
28792420,2sleep1271rcuc/109:56:521
293272400,2sleep029254-21latency_hist11:08:280
293272400,2sleep029254-21latency_hist11:08:280
293272400,2sleep029254-21latency_hist11:08:280
193802400,2sleep119378-21awk12:08:261
193802400,2sleep119378-21awk12:08:261
193802400,2sleep119378-21awk12:08:261
266002380,3chrt0-21swapper/208:08:232
266002380,3chrt0-21swapper/208:08:232
6552993627,6cyclictest16682-21gltestperf10:33:371
157472360,3sleep20-21swapper/210:28:492
157472360,3sleep20-21swapper/210:28:492
6544993526,7cyclictest12524-21needreboot07:28:410
6544993526,7cyclictest12524-21needreboot07:28:410
6544993526,7cyclictest12524-21needreboot07:28:410
6544993428,4cyclictest18859-21missed_timers10:38:390
6544993428,4cyclictest18859-21missed_timers10:38:390
85332330,3chrt0-21swapper/111:38:351
85332330,3chrt0-21swapper/111:38:351
654499332,5cyclictest181rcu_preempt11:34:440
654499332,5cyclictest181rcu_preempt11:34:440
6544993325,6cyclictest9023-21apache209:22:530
6544993325,6cyclictest9023-21apache209:22:530
6544993225,5cyclictest9575-21fschecks_count08:48:350
6544993225,5cyclictest9575-21fschecks_count08:48:350
178912320,3chrt0-21swapper/212:03:362
178912320,3chrt0-21swapper/212:03:362
178912320,3chrt0-21swapper/212:03:362
178912320,3chrt0-21swapper/212:03:362
6552993125,4cyclictest32097-21fschecks_count09:48:371
6552993125,4cyclictest32097-21fschecks_count09:48:371
6552993124,5cyclictest9615-21ntp_kernel_pll_10:13:421
6552993124,5cyclictest9615-21ntp_kernel_pll_10:13:421
114842310,2sleep10-21swapper/110:18:441
114842310,2sleep10-21swapper/110:18:441
6552993025,4cyclictest6526-21cyclictest07:49:201
6552993023,5cyclictest12861-21threads07:28:461
6552993023,5cyclictest12861-21threads07:28:461
6552993023,5cyclictest12861-21threads07:28:461
6552993022,6cyclictest18606-21sort07:43:471
6552993022,6cyclictest18606-21sort07:43:471
6552993022,6cyclictest18606-21sort07:43:471
6544993024,4cyclictest3325-21cpuspeed09:58:360
6544993024,4cyclictest3325-21cpuspeed09:58:360
6544993024,4cyclictest3325-21cpuspeed09:58:360
6544993023,5cyclictest26505-21fschecks_count09:33:360
6544993022,6cyclictest12120-21sshd10:19:540
6544993022,6cyclictest12120-21sshd10:19:540
156752300,2sleep115821-21fschecks_time07:38:361
156752300,2sleep115821-21fschecks_time07:38:361
6552992923,4cyclictest6526-21cyclictest07:23:351
6552992923,4cyclictest6526-21cyclictest07:23:351
6552992923,4cyclictest6526-21cyclictest07:23:351
6552992923,4cyclictest0-21swapper/111:13:471
6552992923,4cyclictest0-21swapper/111:13:471
6552992923,4cyclictest0-21swapper/111:13:471
6552992920,7cyclictest28424-21cut09:38:361
6552992920,7cyclictest28424-21cut09:38:361
6552992920,7cyclictest28424-21cut09:38:361
6544992925,2cyclictest0-21swapper/010:13:430
6544992925,2cyclictest0-21swapper/010:13:430
199192290,3sleep1271rcuc/109:13:471
199192290,3sleep1271rcuc/109:13:471
199192290,3sleep1271rcuc/109:13:471
6565992812,8cyclictest0-21swapper/210:34:432
6565992812,8cyclictest0-21swapper/210:34:432
6565992812,8cyclictest0-21swapper/210:34:432
6552992823,4cyclictest18041-21sh10:38:231
6552992823,4cyclictest18041-21sh10:38:231
6552992823,4cyclictest18041-21sh10:38:231
6552992823,3cyclictest0-21swapper/108:53:461
6552992823,3cyclictest0-21swapper/108:53:461
6552992822,4cyclictest20990-21gltestperf09:18:381
6552992822,4cyclictest20990-21gltestperf09:18:381
6552992822,4cyclictest0-21swapper/111:23:461
6552992822,4cyclictest0-21swapper/111:23:461
6544992823,3cyclictest6526-21cyclictest08:58:310
6544992823,3cyclictest6526-21cyclictest08:58:310
6544992823,3cyclictest17264-21systemctl07:43:230
6544992823,3cyclictest17264-21systemctl07:43:230
6544992823,3cyclictest17264-21systemctl07:43:230
6544992821,5cyclictest31226-21unixbench-2d09:43:480
6544992821,5cyclictest31226-21unixbench-2d09:43:480
6544992821,5cyclictest31226-21unixbench-2d09:43:480
6544992821,5cyclictest22847-21cron07:58:230
6544992821,5cyclictest22847-21cron07:58:230
6544992821,5cyclictest22847-21cron07:58:230
6544992820,6cyclictest483-21timerandwakeup09:48:460
6544992820,6cyclictest483-21timerandwakeup09:48:460
6544992820,6cyclictest18987-21fschecks_count09:13:360
6544992820,6cyclictest18987-21fschecks_count09:13:360
6544992820,6cyclictest18987-21fschecks_count09:13:360
6544992818,8cyclictest29486-21processes08:13:430
6544992818,8cyclictest29486-21processes08:13:430
6544992818,8cyclictest252022ntpq09:28:420
6544992818,8cyclictest252022ntpq09:28:420
6552992721,4cyclictest23320-21ntp_kernel_pll_09:23:411
6552992721,4cyclictest23320-21ntp_kernel_pll_09:23:411
6552992721,4cyclictest14909-21gltestperf10:28:381
6552992721,3cyclictest0-21swapper/108:43:231
6552992721,3cyclictest0-21swapper/108:43:231
6552992721,3cyclictest0-21swapper/108:43:231
6552992720,5cyclictest26983-21head09:33:411
6552992720,5cyclictest26983-21head09:33:411
6552992720,5cyclictest26983-21head09:33:411
6544992722,3cyclictest0-21swapper/007:53:230
6544992722,3cyclictest0-21swapper/007:53:230
6544992722,3cyclictest0-21swapper/007:53:230
6544992720,5cyclictest29185-21head12:33:360
6544992720,5cyclictest29185-21head12:33:360
6544992719,6cyclictest6842-21latency_hist10:08:270
6544992719,6cyclictest6842-21latency_hist10:08:270
6544992719,6cyclictest30531-21cron12:38:230
6544992719,6cyclictest30531-21cron12:38:230
6544992719,6cyclictest30531-21cron12:38:230
6544992718,7cyclictest24208-21gltestperf10:53:380
6544992718,7cyclictest24208-21gltestperf10:53:380
6544992718,7cyclictest24208-21gltestperf10:53:380
654499271,2cyclictest0-21swapper/009:55:420
654499271,2cyclictest0-21swapper/009:55:420
6565992615,5cyclictest0-21swapper/209:45:422
6565992615,5cyclictest0-21swapper/209:45:422
6565992615,5cyclictest0-21swapper/209:45:422
6565992612,6cyclictest0-21swapper/209:05:102
6565992612,6cyclictest0-21swapper/209:05:102
6552992621,4cyclictest601-21snmpd11:03:351
6552992621,4cyclictest601-21snmpd11:03:351
6552992620,4cyclictest31209-21latency_hist11:13:281
6552992620,4cyclictest31209-21latency_hist11:13:281
6552992620,3cyclictest0-21swapper/111:58:401
6552992620,3cyclictest0-21swapper/111:58:401
6552992620,3cyclictest0-21swapper/111:58:401
6552992620,3cyclictest0-21swapper/108:08:501
6552992620,3cyclictest0-21swapper/108:08:501
6552992620,3cyclictest0-21swapper/108:08:501
6552992620,3cyclictest0-21swapper/107:58:361
6552992620,3cyclictest0-21swapper/107:58:361
6552992620,3cyclictest0-21swapper/107:58:361
6552992619,6cyclictest31654-21timerwakeupswit08:18:481
6552992619,6cyclictest31654-21timerwakeupswit08:18:481
6552992619,5cyclictest13166-21kernelversion10:23:391
6552992619,5cyclictest13166-21kernelversion10:23:391
6552992619,4cyclictest31123-21latency_hist12:38:371
6544992622,2cyclictest0-21swapper/010:38:230
6544992622,2cyclictest0-21swapper/010:38:230
6544992622,2cyclictest0-21swapper/010:38:230
6544992621,3cyclictest27368-21cron11:03:230
6544992621,3cyclictest27368-21cron11:03:230
6544992621,3cyclictest27368-21cron11:03:230
6544992621,3cyclictest26822-21acpi08:08:370
6544992621,3cyclictest26822-21acpi08:08:370
6544992621,3cyclictest26822-21acpi08:08:370
6544992619,5cyclictest32151-21processes11:13:460
6544992619,5cyclictest32151-21processes11:13:460
6544992619,5cyclictest32151-21processes11:13:460
6544992618,6cyclictest9023-21apache212:18:240
6544992618,6cyclictest9023-21apache212:18:240
6544992618,6cyclictest9023-21apache212:18:240
6544992618,6cyclictest9023-21apache212:18:240
6565992519,3cyclictest208122sleep212:08:472
6565992519,3cyclictest208122sleep212:08:472
6565992519,3cyclictest208122sleep212:08:472
6565992514,6cyclictest0-21swapper/211:06:142
6565992514,6cyclictest0-21swapper/211:06:142
6565992514,6cyclictest0-21swapper/211:06:142
6565992513,6cyclictest0-21swapper/209:52:422
6565992513,6cyclictest0-21swapper/209:52:422
6565992513,4cyclictest0-21swapper/209:24:412
6565992513,4cyclictest0-21swapper/209:24:412
6552992520,4cyclictest30448-21idleruntime09:43:381
6552992520,4cyclictest30448-21idleruntime09:43:381
6552992520,4cyclictest30448-21idleruntime09:43:381
6552992520,3cyclictest0-21swapper/111:03:231
6552992520,3cyclictest0-21swapper/109:58:471
6552992520,3cyclictest0-21swapper/109:58:471
6552992520,3cyclictest0-21swapper/109:58:471
6552992519,4cyclictest0-21swapper/110:48:461
6552992519,4cyclictest0-21swapper/110:48:461
6552992519,4cyclictest0-21swapper/110:48:461
6552992516,7cyclictest21379-21grep10:43:461
6552992516,7cyclictest21379-21grep10:43:461
6552992516,7cyclictest21379-21grep10:43:461
6544992521,2cyclictest0-21swapper/010:13:350
6544992520,4cyclictest12962-21mailstats11:48:440
6544992520,4cyclictest12962-21mailstats11:48:440
6544992520,3cyclictest316-21head08:23:360
6544992520,3cyclictest316-21head08:23:360
6544992520,3cyclictest316-21head08:23:360
6544992520,3cyclictest0-21swapper/010:48:370
6544992520,3cyclictest0-21swapper/010:48:370
6544992520,3cyclictest0-21swapper/010:48:370
6544992519,4cyclictest749-21runrttasks08:18:350
6544992519,4cyclictest749-21runrttasks08:18:350
6544992518,6cyclictest8498-21switchtime08:43:450
6544992518,6cyclictest8498-21switchtime08:43:450
6544992518,5cyclictest4461-21latency_hist11:28:320
6544992518,5cyclictest4461-21latency_hist11:28:320
6544992518,5cyclictest24929-21cpu08:03:360
6544992518,5cyclictest24929-21cpu08:03:360
262942250,2sleep2351rcuc/210:58:402
262942250,2sleep2351rcuc/210:58:402
262942250,2sleep2351rcuc/210:58:402
6565992418,3cyclictest105272sleep211:43:382
6565992418,3cyclictest105272sleep211:43:382
6565992418,3cyclictest105272sleep211:43:382
6565992414,5cyclictest0-21swapper/208:53:402
6565992414,5cyclictest0-21swapper/208:53:402
6565992411,7cyclictest0-21swapper/209:15:112
6565992411,7cyclictest0-21swapper/209:15:112
6565992411,7cyclictest0-21swapper/209:15:112
6552992420,2cyclictest0-21swapper/108:43:411
6552992420,2cyclictest0-21swapper/108:43:411
6552992419,4cyclictest14678-21systemd-journal10:55:541
6552992419,4cyclictest14678-21systemd-journal10:55:541
6552992419,4cyclictest14678-21systemd-journal10:55:541
6552992419,3cyclictest0-21swapper/112:28:451
6552992419,3cyclictest0-21swapper/112:28:451
6552992419,3cyclictest0-21swapper/112:28:451
6552992417,5cyclictest26762-21latency_hist08:08:321
6552992417,5cyclictest26762-21latency_hist08:08:321
6552992417,5cyclictest20432-21sendmail_mailst12:08:441
6552992417,5cyclictest20432-21sendmail_mailst12:08:441
6552992417,5cyclictest20432-21sendmail_mailst12:08:441
6552992417,5cyclictest11194-21latency_hist08:53:291
6552992417,5cyclictest11194-21latency_hist08:53:291
6544992420,3cyclictest28429-21cut09:38:370
6544992420,3cyclictest28429-21cut09:38:370
6544992420,3cyclictest28429-21cut09:38:370
6544992420,2cyclictest0-21swapper/009:28:360
6544992419,4cyclictest9964-21sendmail11:43:230
6544992419,4cyclictest9964-21sendmail11:43:230
6544992419,4cyclictest17464-21grep12:03:230
6544992419,4cyclictest17464-21grep12:03:230
6544992419,4cyclictest17464-21grep12:03:230
6544992419,4cyclictest17464-21grep12:03:230
6544992419,3cyclictest0-21swapper/009:33:400
6544992419,3cyclictest0-21swapper/009:33:400
6544992419,3cyclictest0-21swapper/009:33:400
6544992418,4cyclictest0-21swapper/008:58:370
6544992418,4cyclictest0-21swapper/008:58:370
6544992418,3cyclictest0-21swapper/010:08:370
6544992417,6cyclictest10700-21kernelversion11:43:400
6544992417,6cyclictest10700-21kernelversion11:43:400
6544992417,6cyclictest10700-21kernelversion11:43:400
6544992417,5cyclictest21630-21grep12:13:370
6544992417,5cyclictest21630-21grep12:13:370
6544992417,5cyclictest21630-21grep12:13:370
6544992416,6cyclictest2831-21ls08:28:450
6544992416,6cyclictest2831-21ls08:28:450
6544992416,6cyclictest11143-21unixbench-2d07:23:470
6544992416,6cyclictest11143-21unixbench-2d07:23:470
6544992416,6cyclictest11143-21unixbench-2d07:23:470
6544992413,9cyclictest19956-21if_eth012:08:380
6544992413,9cyclictest19956-21if_eth012:08:380
6544992413,9cyclictest19956-21if_eth012:08:380
654499241,12cyclictest16512-21fschecks_count10:33:360
654499241,12cyclictest16512-21fschecks_count10:33:360
6544992411,11cyclictest3848-21df_inode08:33:370
6544992411,11cyclictest3848-21df_inode08:33:370
6565992317,3cyclictest0-21swapper/208:44:102
6565992317,3cyclictest0-21swapper/208:44:102
6565992314,6cyclictest0-21swapper/210:58:142
6565992314,6cyclictest0-21swapper/210:58:142
6565992314,6cyclictest0-21swapper/210:58:142
6565992314,6cyclictest0-21swapper/209:08:412
6565992314,6cyclictest0-21swapper/209:08:412
6565992314,6cyclictest0-21swapper/209:08:412
6565992314,6cyclictest0-21swapper/207:53:382
6565992314,6cyclictest0-21swapper/207:53:382
6565992313,7cyclictest0-21swapper/208:28:552
6565992313,7cyclictest0-21swapper/208:28:552
6565992313,5cyclictest0-21swapper/210:22:122
6565992313,5cyclictest0-21swapper/210:22:122
6565992313,5cyclictest0-21swapper/209:55:122
6565992313,5cyclictest0-21swapper/209:55:122
6565992312,6cyclictest0-21swapper/212:30:462
6565992312,6cyclictest0-21swapper/212:30:462
6565992312,6cyclictest0-21swapper/212:30:462
6565992312,6cyclictest0-21swapper/211:15:142
6565992312,6cyclictest0-21swapper/211:15:142
6565992312,6cyclictest0-21swapper/211:15:142
6565992312,6cyclictest0-21swapper/207:36:082
6565992312,6cyclictest0-21swapper/207:36:082
6565992312,6cyclictest0-21swapper/207:36:082
6565992312,5cyclictest0-21swapper/211:54:452
6565992312,5cyclictest0-21swapper/211:54:452
6565992312,5cyclictest0-21swapper/211:54:452
6565992312,5cyclictest0-21swapper/207:27:382
6565992312,5cyclictest0-21swapper/207:27:382
6565992312,5cyclictest0-21swapper/207:27:382
6552992318,3cyclictest0-21swapper/112:03:341
6552992318,3cyclictest0-21swapper/112:03:341
6552992318,3cyclictest0-21swapper/112:03:341
6552992318,3cyclictest0-21swapper/112:03:341
6552992318,3cyclictest0-21swapper/109:13:371
6552992318,3cyclictest0-21swapper/109:13:371
6552992318,3cyclictest0-21swapper/109:13:371
6552992318,3cyclictest0-21swapper/109:03:331
6552992318,3cyclictest0-21swapper/109:03:331
6552992318,3cyclictest0-21swapper/107:33:461
6552992317,3cyclictest0-21swapper/112:33:381
6552992317,3cyclictest0-21swapper/112:33:381
6544992318,3cyclictest0-21swapper/012:28:440
6544992318,3cyclictest0-21swapper/010:28:370
6544992318,3cyclictest0-21swapper/010:28:370
6544992318,3cyclictest0-21swapper/007:48:350
6544992318,3cyclictest0-21swapper/007:48:350
6544992318,3cyclictest0-21swapper/007:48:350
6544992318,2cyclictest0-21swapper/008:08:280
6544992318,2cyclictest0-21swapper/008:08:280
6544992316,4cyclictest0-21swapper/011:28:440
6544992316,4cyclictest0-21swapper/011:28:440
6544992316,4cyclictest0-21swapper/011:28:440
6544992314,7cyclictest27502-21kernelversion12:28:380
6544992314,7cyclictest27502-21kernelversion12:28:380
209892230,3chrt0-21swapper/209:18:382
209892230,3chrt0-21swapper/209:18:382
6565992217,3cyclictest0-21swapper/209:28:412
6565992217,3cyclictest0-21swapper/209:28:412
6565992217,3cyclictest0-21swapper/209:28:412
6565992215,4cyclictest0-21swapper/211:24:152
6565992215,4cyclictest0-21swapper/211:24:152
6565992214,6cyclictest0-21swapper/211:48:452
6565992214,6cyclictest0-21swapper/211:48:452
6565992214,6cyclictest0-21swapper/209:39:112
6565992214,6cyclictest0-21swapper/209:39:112
6565992214,6cyclictest0-21swapper/209:39:112
6565992214,6cyclictest0-21swapper/207:51:092
6565992212,6cyclictest0-21swapper/211:34:152
6565992212,6cyclictest0-21swapper/211:34:152
6565992212,5cyclictest0-21swapper/211:39:152
6565992212,5cyclictest0-21swapper/211:39:152
6565992212,5cyclictest0-21swapper/209:03:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional