You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 21:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sat Jul 18, 2026 12:44:19)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1150821140,3chrt0-21swapper/109:38:381
1150821140,3chrt0-21swapper/109:38:381
143322990,3sleep20-21swapper/212:38:442
143322990,3sleep20-21swapper/212:38:442
206112870,1sleep00-21swapper/010:03:370
206112870,1sleep00-21swapper/010:03:370
206112870,1sleep00-21swapper/010:03:370
145662850,3chrt0-21swapper/009:48:260
145662850,3chrt0-21swapper/009:48:260
145662850,3chrt0-21swapper/009:48:260
135772840,4sleep013580-21fschecks_count08:18:370
135772840,4sleep013580-21fschecks_count08:18:370
25312790,3chrt0-21swapper/309:13:473
277262650,1sleep3431rcuc/307:28:393
277262650,1sleep3431rcuc/307:28:393
243102650,2chrt24296-21fschecks_time10:13:380
243102650,2chrt24296-21fschecks_time10:13:380
243102650,2chrt24296-21fschecks_time10:13:380
243102650,2chrt24296-21fschecks_time10:13:380
201072470,3sleep30-21swapper/310:03:243
201072470,3sleep30-21swapper/310:03:243
201072470,3sleep30-21swapper/310:03:243
93952450,3sleep00-21swapper/009:33:380
93952450,3sleep00-21swapper/009:33:380
313072440,2sleep031490-21head09:03:480
313072440,2sleep031490-21head09:03:480
154592430,2sleep20-21swapper/209:48:442
154592430,2sleep20-21swapper/209:48:442
154592430,2sleep20-21swapper/209:48:442
309122400,3sleep20-21swapper/211:58:322
309122400,3sleep20-21swapper/211:58:322
309122400,3sleep20-21swapper/211:58:322
21484993914,6cyclictest201rcuc/009:28:100
21484993914,6cyclictest201rcuc/009:28:100
21484993914,6cyclictest201rcuc/009:28:100
21484993829,7cyclictest8796-21threads08:03:470
21484993829,7cyclictest8796-21threads08:03:470
266212370,3sleep30-21swapper/310:18:443
266212370,3sleep30-21swapper/310:18:443
266212370,3sleep30-21swapper/310:18:443
2148499377,5cyclictest171ktimers/009:23:100
2148499377,5cyclictest171ktimers/009:23:100
21484993710,14cyclictest16-21ksoftirqd/011:18:250
21484993710,14cyclictest16-21ksoftirqd/011:18:250
21484993710,14cyclictest16-21ksoftirqd/011:18:250
21484993611,5cyclictest201rcuc/012:19:450
21484993611,5cyclictest201rcuc/012:19:450
21484993611,5cyclictest201rcuc/012:19:450
21484993525,7cyclictest5418-21unixbench_singl12:13:490
21484993427,5cyclictest749-21runrttasks09:28:450
21484993427,5cyclictest749-21runrttasks09:28:450
21484993416,3cyclictest181rcu_preempt07:50:070
21484993416,3cyclictest181rcu_preempt07:50:070
84952330,3sleep20-21swapper/212:23:412
84952330,3sleep20-21swapper/212:23:412
84952330,3sleep20-21swapper/212:23:412
21484993327,5cyclictest11669-21/usr/sbin/munin12:33:450
21484993327,5cyclictest11669-21/usr/sbin/munin12:33:450
21484993326,5cyclictest201rcuc/009:54:410
21484993326,5cyclictest201rcuc/009:54:410
21484993326,5cyclictest201rcuc/009:54:410
28892320,3sleep00-21swapper/012:08:390
28892320,3sleep00-21swapper/012:08:390
28892320,3sleep00-21swapper/012:08:390
256092320,2sleep0171ktimers/010:16:560
256092320,2sleep0171ktimers/010:16:560
256092320,2sleep0171ktimers/010:16:560
21485993226,4cyclictest32482-21systemctl07:43:241
21485993226,4cyclictest32482-21systemctl07:43:241
21485993224,6cyclictest6910-21threads07:58:461
21484993226,4cyclictest201rcuc/011:24:440
21484993226,4cyclictest201rcuc/011:24:440
21484993226,4cyclictest201rcuc/011:24:440
21484993224,6cyclictest27153-21cpuspeed07:28:340
21484993224,6cyclictest12344-21processes08:13:470
21484993224,6cyclictest12344-21processes08:13:470
21484993224,6cyclictest12344-21processes08:13:470
21484993218,4cyclictest90-1pr/ttyS011:28:380
21484993218,4cyclictest90-1pr/ttyS011:28:380
21484993218,4cyclictest90-1pr/ttyS011:28:380
21485993126,4cyclictest5424-21cpuspeed09:23:351
21485993126,4cyclictest5424-21cpuspeed09:23:351
21485993126,4cyclictest5424-21cpuspeed09:23:351
21485993126,4cyclictest11855-21gltestperf08:13:401
21485993126,4cyclictest11855-21gltestperf08:13:401
21485993126,4cyclictest11855-21gltestperf08:13:401
21485993123,6cyclictest2017-21threads10:38:481
21485993123,6cyclictest18708-21cut09:58:391
21485993123,6cyclictest18708-21cut09:58:391
21485993123,6cyclictest18708-21cut09:58:391
2148499317,5cyclictest201rcuc/011:44:140
2148499317,5cyclictest201rcuc/011:44:140
21484993122,7cyclictest32561-21if_eth009:08:390
21484993122,7cyclictest32561-21if_eth009:08:390
21485993023,5cyclictest5101-21grep09:23:241
21485993023,5cyclictest5101-21grep09:23:241
21485993023,5cyclictest25740-21gltestperf11:43:381
21485993023,5cyclictest25740-21gltestperf11:43:381
2148499307,4cyclictest201rcuc/011:50:140
2148499307,4cyclictest201rcuc/011:50:140
2148499307,4cyclictest201rcuc/011:50:140
21484993025,3cyclictest0-21swapper/008:08:370
21484993025,3cyclictest0-21swapper/008:08:370
21484993014,7cyclictest16-21ksoftirqd/009:41:160
21484993014,7cyclictest16-21ksoftirqd/009:41:160
21484993011,4cyclictest181rcu_preempt11:20:430
21484993011,4cyclictest181rcu_preempt11:20:430
21484993011,4cyclictest181rcu_preempt11:20:430
58002291,2sleep00-21swapper/010:48:490
58002291,2sleep00-21swapper/010:48:490
21485992924,3cyclictest21483-21cyclictest09:08:481
21485992924,3cyclictest21483-21cyclictest09:08:481
21485992921,6cyclictest1137-21netstat12:03:451
21485992921,6cyclictest1137-21netstat12:03:451
21485992921,6cyclictest1137-21netstat12:03:451
21485992920,7cyclictest22799-21unixbench-2d11:33:471
21484992924,4cyclictest32055-21/usr/sbin/munin11:58:470
21484992924,4cyclictest32055-21/usr/sbin/munin11:58:470
21484992924,4cyclictest32055-21/usr/sbin/munin11:58:470
21484992923,4cyclictest29673-21latency11:53:400
21484992923,4cyclictest29673-21latency11:53:400
21484992923,4cyclictest29673-21latency11:53:400
21484992923,3cyclictest0-21swapper/012:08:140
21484992923,3cyclictest0-21swapper/012:08:140
21484992923,3cyclictest0-21swapper/012:08:140
21484992921,6cyclictest17306-21netstat09:53:410
21485992823,3cyclictest0-21swapper/110:18:411
21485992822,4cyclictest21483-21cyclictest11:08:411
21485992822,4cyclictest21483-21cyclictest11:08:411
21485992822,4cyclictest21483-21cyclictest11:08:411
21485992821,5cyclictest21483-21cyclictest09:50:561
21485992821,5cyclictest21483-21cyclictest09:50:561
21485992821,5cyclictest21483-21cyclictest09:50:561
2148499287,4cyclictest201rcuc/010:39:120
21484992824,2cyclictest0-21swapper/011:08:380
21484992824,2cyclictest0-21swapper/011:08:380
21484992824,2cyclictest0-21swapper/011:08:380
21484992821,5cyclictest775-21kernelversion07:43:400
21484992821,5cyclictest775-21kernelversion07:43:400
21484992819,3cyclictest181rcu_preempt10:36:420
21484992819,3cyclictest181rcu_preempt10:36:420
21484992819,3cyclictest181rcu_preempt10:31:560
21484992819,3cyclictest181rcu_preempt10:31:560
21484992819,3cyclictest181rcu_preempt10:31:560
21484992817,3cyclictest181rcu_preempt07:36:060
21484992817,3cyclictest181rcu_preempt07:36:060
21484992814,8cyclictest90-1pr/ttyS012:39:560
21484992814,8cyclictest90-1pr/ttyS012:39:560
163952280,7sleep016398-21latency_hist09:53:240
163952280,7sleep016398-21latency_hist09:53:240
259052270,3sleep30-21swapper/307:23:413
21485992722,4cyclictest493-21fschecks_time07:43:371
21485992722,4cyclictest493-21fschecks_time07:43:371
21485992722,3cyclictest0-21swapper/107:33:471
21485992722,3cyclictest0-21swapper/107:33:471
21485992721,4cyclictest749-21runrttasks10:18:391
21485992721,4cyclictest749-21runrttasks10:18:391
21485992720,5cyclictest10166-21latency_hist11:03:361
21485992719,6cyclictest10098-21fschecks_time12:28:381
21485992719,6cyclictest10098-21fschecks_time12:28:381
21485992719,6cyclictest10098-21fschecks_time12:28:381
21485992718,7cyclictest13048-21fschecks_count09:43:371
21485992718,7cyclictest13048-21fschecks_count09:43:371
21485992718,7cyclictest13048-21fschecks_count09:43:371
2148499277,18cyclictest201rcuc/007:54:370
2148499277,18cyclictest201rcuc/007:54:370
21484992723,3cyclictest90-1pr/ttyS010:27:110
21484992723,3cyclictest90-1pr/ttyS010:27:110
21484992722,4cyclictest3238-21gltestperf10:43:380
21484992722,4cyclictest3238-21gltestperf10:43:380
21484992722,4cyclictest3238-21gltestperf10:43:380
21484992722,4cyclictest3238-21gltestperf10:43:380
21484992722,4cyclictest25725-21sh10:18:420
21484992722,4cyclictest25725-21sh10:18:420
21484992722,4cyclictest25725-21sh10:18:420
21484992722,3cyclictest171ktimers/008:58:480
21484992722,3cyclictest171ktimers/008:58:480
21484992722,3cyclictest171ktimers/008:58:480
21484992719,6cyclictest6841-21sort10:53:380
21484992719,6cyclictest6841-21sort10:53:380
21484992719,6cyclictest22888-21sort08:43:350
21484992719,6cyclictest22888-21sort08:43:350
21484992719,3cyclictest181rcu_preempt09:14:390
21484992718,7cyclictest12451-21fschecks_count11:08:370
21484992717,7cyclictest171ktimers/008:25:260
21484992717,7cyclictest171ktimers/008:25:260
21484992717,2cyclictest181rcu_preempt08:36:560
21484992717,2cyclictest181rcu_preempt08:36:560
21485992622,2cyclictest0-21swapper/109:03:241
21485992622,2cyclictest0-21swapper/109:03:241
21485992622,2cyclictest0-21swapper/109:03:241
21485992621,3cyclictest22001-21latency_hist10:08:401
21485992621,3cyclictest22001-21latency_hist10:08:401
21485992621,3cyclictest22001-21latency_hist10:08:401
21485992620,4cyclictest18408-21kernelversion11:23:401
21485992620,4cyclictest18408-21kernelversion11:23:401
21485992620,4cyclictest18408-21kernelversion11:23:401
21485992619,5cyclictest10178-21latency_hist11:03:241
21484992621,4cyclictest31091-21fschecks_time07:38:370
21484992621,4cyclictest31091-21fschecks_time07:38:370
21484992621,3cyclictest0-21swapper/011:33:430
21484992620,4cyclictest0-21swapper/011:03:380
21484992620,4cyclictest0-21swapper/011:03:380
21484992619,2cyclictest181rcu_preempt08:48:360
21484992619,2cyclictest181rcu_preempt08:48:360
21484992618,6cyclictest7745-21latency_hist08:03:330
21484992618,2cyclictest181rcu_preempt08:28:470
21484992618,2cyclictest181rcu_preempt08:28:470
21485992520,4cyclictest24985-21kworker/u9:0-rpciod07:24:371
21485992520,4cyclictest14825-21head11:13:431
21485992520,4cyclictest14825-21head11:13:431
21485992520,4cyclictest14825-21head11:13:431
21485992520,3cyclictest0-21swapper/110:03:371
21485992520,3cyclictest0-21swapper/110:03:371
21485992520,3cyclictest0-21swapper/110:03:371
21485992519,3cyclictest0-21swapper/108:43:441
21485992519,3cyclictest0-21swapper/108:43:441
21485992518,5cyclictest8922-21latency_hist09:33:271
21485992518,5cyclictest8922-21latency_hist09:33:271
21485992518,5cyclictest29029-21unixbench_multi10:23:461
21485992518,5cyclictest29029-21unixbench_multi10:23:461
21485992518,5cyclictest0-21swapper/111:58:371
21485992517,6cyclictest8142-21gltestperf08:03:381
21485992517,6cyclictest8142-21gltestperf08:03:381
21484992520,3cyclictest0-21swapper/010:03:430
21484992520,3cyclictest0-21swapper/010:03:430
21484992520,3cyclictest0-21swapper/010:03:430
21484992519,5cyclictest22562-21latency_hist08:43:240
21484992519,5cyclictest22562-21latency_hist08:43:240
21485992419,4cyclictest7301-21grep10:53:431
21485992419,4cyclictest7301-21grep10:53:431
21485992419,4cyclictest14678-21systemd-journal10:19:561
21485992419,4cyclictest14678-21systemd-journal10:19:561
21485992419,4cyclictest14678-21systemd-journal10:19:561
21485992419,3cyclictest0-21swapper/112:18:421
21485992419,3cyclictest0-21swapper/112:18:421
21485992419,3cyclictest0-21swapper/112:18:421
21485992419,3cyclictest0-21swapper/110:48:241
21485992419,3cyclictest0-21swapper/110:48:241
21485992419,3cyclictest0-21swapper/110:48:241
21485992419,3cyclictest0-21swapper/110:48:241
21485992419,3cyclictest0-21swapper/109:03:391
21485992419,3cyclictest0-21swapper/109:03:391
21485992418,3cyclictest0-21swapper/111:38:391
21485992418,3cyclictest0-21swapper/111:38:391
21485992418,3cyclictest0-21swapper/108:53:241
21485992418,3cyclictest0-21swapper/108:53:241
21485992417,5cyclictest21483-21cyclictest09:38:361
21485992417,5cyclictest18773-21sshd08:32:561
21485992417,5cyclictest18773-21sshd08:32:561
21485992416,6cyclictest2388-21cut07:48:371
21485992416,6cyclictest2388-21cut07:48:371
21485992416,6cyclictest1-21systemd08:25:561
21485992416,6cyclictest1-21systemd08:25:561
21484992419,3cyclictest171ktimers/007:33:300
21484992419,3cyclictest171ktimers/007:33:300
21484992419,3cyclictest0-21swapper/011:38:370
21484992419,3cyclictest0-21swapper/011:38:370
21484992417,5cyclictest0-21swapper/012:28:450
21484992417,5cyclictest0-21swapper/012:28:450
21484992417,5cyclictest0-21swapper/012:28:450
21485992319,3cyclictest547-21rs:main1
21485992319,3cyclictest547-21rs:main1
21485992319,3cyclictest547-21rs:main1
21485992319,3cyclictest14073-21needreboot08:18:421
21485992319,3cyclictest14073-21needreboot08:18:421
21485992318,3cyclictest0-21swapper/112:33:481
21485992318,3cyclictest0-21swapper/112:33:481
21485992318,3cyclictest0-21swapper/107:53:461
21485992318,3cyclictest0-21swapper/107:53:461
21485992318,2cyclictest0-21swapper/110:28:461
21485992318,2cyclictest0-21swapper/110:28:461
21485992318,2cyclictest0-21swapper/110:28:461
21485992317,4cyclictest9451-21grep09:33:391
21485992317,4cyclictest1346-21avahi-daemon12:08:441
21485992317,4cyclictest1346-21avahi-daemon12:08:441
21485992317,4cyclictest1346-21avahi-daemon12:08:441
21485992316,4cyclictest0-21swapper/112:13:491
21485992315,6cyclictest20888-21latency_hist08:38:321
21485992313,8cyclictest21096-21sshd11:29:211
21485992313,8cyclictest21096-21sshd11:29:211
21485992313,8cyclictest21096-21sshd11:29:211
2148499234,5cyclictest171ktimers/008:53:460
2148499234,5cyclictest171ktimers/008:53:460
2148499234,5cyclictest171ktimers/008:53:460
21484992312,3cyclictest181rcu_preempt12:23:370
21484992312,3cyclictest181rcu_preempt12:23:370
21484992312,3cyclictest181rcu_preempt12:23:370
21485992218,3cyclictest32150-21grep11:58:481
21485992218,3cyclictest32150-21grep11:58:481
21485992218,3cyclictest32150-21grep11:58:481
21485992217,4cyclictest21217-21gltestperf08:38:361
21485992217,4cyclictest21217-21gltestperf08:38:361
21485992217,3cyclictest0-21swapper/110:48:421
21485992217,3cyclictest0-21swapper/110:48:421
21485992217,3cyclictest0-21swapper/109:13:441
21485992217,3cyclictest0-21swapper/107:33:241
21485992217,3cyclictest0-21swapper/107:33:241
21485992216,3cyclictest0-21swapper/110:13:371
21485992216,3cyclictest0-21swapper/110:13:371
21485992216,3cyclictest0-21swapper/110:13:371
21485992216,3cyclictest0-21swapper/110:13:371
21485992215,5cyclictest30816-21latency_hist11:58:271
21485992215,5cyclictest30816-21latency_hist11:58:271
21485992215,5cyclictest10925-21kernelversion11:03:401
21485992215,5cyclictest10925-21kernelversion11:03:401
21485992215,5cyclictest10925-21kernelversion11:03:401
21484992217,3cyclictest0-21swapper/010:58:380
21484992217,3cyclictest0-21swapper/010:58:380
90772210,3sleep30-21swapper/308:03:493
90772210,3sleep30-21swapper/308:03:493
21485992116,3cyclictest0-21swapper/112:38:391
21485992116,3cyclictest0-21swapper/112:38:391
21485992115,4cyclictest0-21swapper/111:23:361
21485992115,4cyclictest0-21swapper/111:23:361
21485992115,4cyclictest0-21swapper/111:23:361
21485992115,4cyclictest0-21swapper/108:53:461
21485992115,4cyclictest0-21swapper/108:53:461
21485992115,4cyclictest0-21swapper/108:53:461
21485992111,8cyclictest19746-21nfs4_client08:33:441
62962200,2sleep20-21swapper/212:18:382
62962200,2sleep20-21swapper/212:18:382
62962200,2sleep20-21swapper/212:18:382
280052200,3sleep30-21swapper/311:48:453
280052200,3sleep30-21swapper/311:48:453
280052200,3sleep30-21swapper/311:48:453
21485992016,2cyclictest0-21swapper/108:08:401
21485992016,2cyclictest0-21swapper/108:08:401
21485992011,7cyclictest14678-21systemd-journal10:36:121
21485992011,7cyclictest14678-21systemd-journal10:36:121
2148899191,15cyclictest30694-21taskset07:38:283
2148899191,15cyclictest30694-21taskset07:38:283
130252190,3sleep30-21swapper/311:08:453
130252190,3sleep30-21swapper/311:08:453
130252190,3sleep30-21swapper/311:08:453
21488991814,3cyclictest431rcuc/308:50:093
21488991814,3cyclictest431rcuc/308:50:093
21488991811,5cyclictest431rcuc/308:01:073
21486991812,3cyclictest242542chrt11:38:432
21486991812,3cyclictest242542chrt11:38:432
21485991813,3cyclictest0-21swapper/112:23:471
21485991813,3cyclictest0-21swapper/112:23:471
21485991813,3cyclictest0-21swapper/112:23:471
2148899173,10cyclictest0-21swapper/308:35:083
2148899173,10cyclictest0-21swapper/308:35:083
2148899172,11cyclictest0-21swapper/309:38:333
2148899172,11cyclictest0-21swapper/309:38:333
2148899171,12cyclictest8751-21chrt12:23:463
2148899171,12cyclictest8751-21chrt12:23:463
2148899171,12cyclictest8751-21chrt12:23:463
2148899171,11cyclictest12365-21chrt11:08:373
2148899171,11cyclictest12365-21chrt11:08:373
2148699174,8cyclictest34882sleep207:49:372
2148699174,8cyclictest34882sleep207:49:372
2148699171,12cyclictest18480-21chrt09:58:372
2148699171,12cyclictest18480-21chrt09:58:372
2148699171,12cyclictest18480-21chrt09:58:372
2148699171,11cyclictest28549-21chrt10:23:412
2148699171,11cyclictest28549-21chrt10:23:412
2148699171,11cyclictest28549-21chrt10:23:412
2148899162,9cyclictest0-21swapper/307:53:073
2148899162,9cyclictest0-21swapper/307:53:073
2148899162,11cyclictest0-21swapper/307:58:283
2148899162,11cyclictest0-21swapper/307:58:283
2148899161,13cyclictest24671-21chrt10:13:413
2148899161,13cyclictest24671-21chrt10:13:413
2148899161,12cyclictest5543-21chrt09:23:363
2148899161,12cyclictest5543-21chrt09:23:363
2148899161,12cyclictest5543-21chrt09:23:363
2148899161,12cyclictest17419-21taskset08:28:373
2148899161,12cyclictest17419-21taskset08:28:373
2148899161,12cyclictest15602-21chrt11:15:563
2148899161,12cyclictest15602-21chrt11:15:563
2148899161,12cyclictest15602-21chrt11:15:563
2148899161,11cyclictest2839-21taskset10:43:323
2148899161,11cyclictest2785-21taskset12:08:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional