You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-16 - 02:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Sun Aug 16, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2334321010,3sleep10-21swapper/123:29:141
2334321010,3sleep10-21swapper/123:29:141
13602870,3chrt0-21swapper/322:33:573
131242860,2sleep30-21swapper/300:29:103
131242860,2sleep30-21swapper/300:29:103
237992830,3chrt23803-21timerwakeupswit22:04:161
237992830,3chrt23803-21timerwakeupswit22:04:161
262622810,1sleep3431rcuc/323:39:053
262622810,1sleep3431rcuc/323:39:053
51082780,3sleep30-21swapper/319:49:073
325142770,3sleep20-21swapper/219:34:142
325142770,3sleep20-21swapper/219:34:142
318572750,3chrt0-21swapper/122:28:521
282512730,3sleep30-21swapper/323:44:083
282512730,3sleep30-21swapper/323:44:083
24582670,3sleep20-21swapper/222:34:122
24582670,3sleep20-21swapper/222:34:122
37212660,4chrt16-21ksoftirqd/000:04:150
114092610,3chrt0-21swapper/222:59:082
114092610,3chrt0-21swapper/222:59:082
202392590,4chrt0-21swapper/323:24:023
202392590,4chrt0-21swapper/323:24:023
159332570,4chrt15938-21cpu00:39:011
159332570,4chrt15938-21cpu00:39:011
24078995650,3cyclictest0-21swapper/100:04:071
261032540,4chrt0-21swapper/223:39:042
261032540,4chrt0-21swapper/223:39:042
41092530,2sleep30-21swapper/322:39:113
41092530,2sleep30-21swapper/322:39:113
73902510,3chrt0-21swapper/322:49:043
73902510,3chrt0-21swapper/322:49:043
52002460,2chrt0-21swapper/300:09:083
99232450,2sleep2351rcuc/221:29:032
265722450,3chrt0-21swapper/322:14:033
33462430,2sleep00-21swapper/019:44:100
244432420,3sleep20-21swapper/220:39:152
244432420,3sleep20-21swapper/220:39:152
24076994230,7cyclictest1346-21avahi-daemon00:03:530
24076994230,7cyclictest1346-21avahi-daemon00:03:530
24076994230,7cyclictest1346-21avahi-daemon00:03:530
313152410,3sleep20-21swapper/220:59:042
313152410,3sleep20-21swapper/220:59:042
24078993931,6cyclictest25586-21cron23:38:501
110432380,3sleep20-21swapper/220:04:132
79582360,2chrt7959-21sshd19:58:291
319252360,2sleep10-21swapper/120:59:121
319252360,2sleep10-21swapper/120:59:121
24078993629,5cyclictest21628-21cut20:34:031
24076993627,7cyclictest25778-21needreboot20:44:070
24076993627,7cyclictest25778-21needreboot20:44:070
225422360,2sleep30-21swapper/322:03:543
225422360,2sleep30-21swapper/322:03:543
118282360,2sleep00-21swapper/022:59:150
118282360,2sleep00-21swapper/022:59:150
160852350,11sleep1271rcuc/120:19:041
160852350,11sleep1271rcuc/120:19:041
12952350,2sleep01319-21latency_hist22:33:550
43602340,3sleep30-21swapper/321:14:053
36942340,2sleep10-21swapper/122:39:061
36942340,2sleep10-21swapper/122:39:061
2408099341,26cyclictest2750-21chrt00:04:023
195822340,3sleep10-21swapper/121:54:071
170372340,3sleep30-21swapper/320:19:353
170372340,3sleep30-21swapper/320:19:353
121282340,2sleep012162-21ntp_states21:34:090
260612330,3chrt0-21swapper/222:12:292
260612330,3chrt0-21swapper/222:12:292
24078993326,5cyclictest12911-21cut23:04:001
24078993225,5cyclictest5789-21sshd19:49:301
24076993224,6cyclictest3814-21kernelversion22:39:070
24076993224,6cyclictest3814-21kernelversion22:39:070
100792320,3sleep20-21swapper/220:03:582
294862310,1sleep1251irq_work/120:54:051
24078993126,4cyclictest25597-21kernelversion20:44:041
24078993126,4cyclictest25597-21kernelversion20:44:041
24078993125,4cyclictest12216-21fschecks_time20:09:021
24078993125,4cyclictest12216-21fschecks_time20:09:021
24078993122,7cyclictest13893-21latency_hist00:33:521
24078993122,7cyclictest13893-21latency_hist00:33:521
220362310,2sleep022068-21cat23:28:580
24078993023,5cyclictest2375-21wc19:43:501
24078993023,5cyclictest2375-21wc19:43:501
24078993023,5cyclictest2375-21wc19:43:501
24078993023,5cyclictest2201-21fschecks_count21:09:021
24078993021,7cyclictest4125-21cut21:14:031
24078993021,7cyclictest28496-21cut22:19:031
24078993021,7cyclictest28496-21cut22:19:031
24076993024,5cyclictest28964-21fschecks_count20:54:010
24076993023,5cyclictest6176-21switchtime22:44:110
24076993023,5cyclictest6176-21switchtime22:44:110
24076993023,5cyclictest11635-21sshd00:25:120
24076993023,5cyclictest11635-21sshd00:25:120
161362300,2sleep116312-21sed21:44:111
2408099293,22cyclictest2614-21chrt00:03:533
2408099293,22cyclictest2614-21chrt00:03:533
24078992922,5cyclictest9293-21timerandwakeup19:59:131
24078992922,5cyclictest9293-21timerandwakeup19:59:131
24078992922,5cyclictest24074-21cyclictest23:41:431
24078992922,5cyclictest24074-21cyclictest23:41:431
24078992919,7cyclictest31273-21latency_hist23:53:521
24078992919,7cyclictest31273-21latency_hist23:53:521
24076992924,3cyclictest24074-21cyclictest22:58:270
24076992921,6cyclictest5648-21grep19:49:130
68212280,2sleep30-21swapper/321:19:123
68212280,2sleep30-21swapper/321:19:123
24078992820,6cyclictest15079-21unixbench_multi20:14:131
24078992820,6cyclictest15079-21unixbench_multi20:14:131
24076992823,3cyclictest0-21swapper/022:34:110
24076992823,3cyclictest0-21swapper/022:34:110
24076992821,5cyclictest25745-21unixbench_singl22:09:120
24076992821,5cyclictest25745-21unixbench_singl22:09:120
24076992821,5cyclictest19981-21kernelversion20:29:080
24076992821,5cyclictest14945-21latency_hist21:43:490
24076992821,5cyclictest14945-21latency_hist21:43:490
24076992821,5cyclictest12812-21needreboot00:29:060
24076992821,5cyclictest12812-21needreboot00:29:060
110332280,3sleep20-21swapper/200:24:112
110332280,3sleep20-21swapper/200:24:112
24078992722,4cyclictest10509-21fschecks_time00:24:041
24078992722,4cyclictest10509-21fschecks_time00:24:041
24078992722,4cyclictest10115-21latency21:29:051
24078992722,3cyclictest0-21swapper/123:19:141
24078992722,3cyclictest0-21swapper/123:19:141
24078992722,3cyclictest0-21swapper/123:19:141
24078992720,5cyclictest8863-21kernelversion00:19:061
24078992720,5cyclictest8863-21kernelversion00:19:061
24078992719,6cyclictest20545-21sort20:29:161
2407899271,7cyclictest70042grep21:19:131
2407899271,7cyclictest70042grep21:19:131
24076992722,3cyclictest0-21swapper/022:08:490
24076992722,3cyclictest0-21swapper/022:08:490
24076992722,3cyclictest0-21swapper/019:58:500
24076992721,5cyclictest17129-21sshd20:20:440
24076992721,5cyclictest17129-21sshd20:20:440
24076992721,3cyclictest0-21swapper/021:19:100
24076992721,3cyclictest0-21swapper/021:19:100
24076992721,3cyclictest0-21swapper/000:43:500
24076992721,3cyclictest0-21swapper/000:43:500
24076992719,6cyclictest8346-21needreboot21:24:080
24076992719,6cyclictest8346-21needreboot21:24:080
24076992719,6cyclictest11779-21latency_hist20:08:500
24076992717,7cyclictest27637-21latency_hist23:43:580
24076992717,7cyclictest27637-21latency_hist23:43:580
17922270,3sleep10-21swapper/122:34:031
17922270,3sleep10-21swapper/122:34:031
247832260,3sleep30-21swapper/323:34:113
24078992622,2cyclictest0-21swapper/121:34:031
24078992622,2cyclictest0-21swapper/100:14:121
24078992622,2cyclictest0-21swapper/100:14:121
24078992622,2cyclictest0-21swapper/100:03:501
24078992622,2cyclictest0-21swapper/100:03:501
24078992622,2cyclictest0-21swapper/100:03:501
24078992621,3cyclictest0-21swapper/123:09:121
24078992621,3cyclictest0-21swapper/123:09:121
24078992620,4cyclictest0-21swapper/120:43:501
24078992620,4cyclictest0-21swapper/120:43:501
24078992620,3cyclictest0-21swapper/121:59:011
24078992620,3cyclictest0-21swapper/121:59:011
24078992620,3cyclictest0-21swapper/121:39:071
24078992620,3cyclictest0-21swapper/121:39:071
24078992618,6cyclictest24531-21/usr/sbin/munin22:09:071
24078992618,6cyclictest24531-21/usr/sbin/munin22:09:071
24076992621,4cyclictest32435-21unixbench-2d19:34:140
24076992621,4cyclictest32435-21unixbench-2d19:34:140
24076992621,3cyclictest0-21swapper/023:23:500
24076992621,3cyclictest0-21swapper/023:23:500
24076992621,3cyclictest0-21swapper/023:23:500
24076992620,4cyclictest1346-21avahi-daemon22:14:110
24076992620,3cyclictest0-21swapper/020:28:500
24076992620,3cyclictest0-21swapper/020:28:500
24076992619,5cyclictest30896-21sh22:24:100
24076992619,5cyclictest28428-21fschecks_count22:19:030
24076992619,5cyclictest28428-21fschecks_count22:19:030
24076992619,4cyclictest0-21swapper/020:49:130
24076992616,8cyclictest19441-21cat21:54:050
24080992518,4cyclictest157492sleep323:09:143
24080992518,4cyclictest157492sleep323:09:143
24078992519,5cyclictest20284-21cpuspeed23:24:021
24078992519,5cyclictest20284-21cpuspeed23:24:021
24078992519,3cyclictest0-21swapper/121:49:131
24078992519,3cyclictest0-21swapper/121:49:131
24078992518,6cyclictest12320-21sshd23:01:571
24078992518,6cyclictest12320-21sshd23:01:571
24078992516,7cyclictest7363-21cut22:49:041
24078992516,7cyclictest7363-21cut22:49:041
24078992513,10cyclictest8217-21latency21:24:061
24078992513,10cyclictest8217-21latency21:24:061
24076992519,4cyclictest0-21swapper/000:09:060
24076992517,6cyclictest310-21fschecks_time21:04:030
24076992517,6cyclictest310-21fschecks_time21:04:030
24076992516,7cyclictest24990-21latency_hist20:43:530
24076992516,7cyclictest24990-21latency_hist20:43:530
327582240,2sleep132757-21ntp_states22:29:081
24078992419,3cyclictest0-21swapper/100:09:051
2407899241,8cyclictest14381-21sed00:34:051
24078992418,3cyclictest0-21swapper/123:14:061
24078992418,3cyclictest0-21swapper/123:14:061
24078992416,6cyclictest8947-21/usr/sbin/munin22:54:091
24076992420,2cyclictest0-21swapper/020:18:500
24076992420,2cyclictest0-21swapper/020:18:500
24076992418,5cyclictest31766-21timerwakeupswit20:59:110
24076992418,5cyclictest31766-21timerwakeupswit20:59:110
24076992418,4cyclictest8479-21fschecks_time19:59:040
24076992418,4cyclictest8479-21fschecks_time19:59:040
24076992416,6cyclictest31950-21latency23:54:060
24076992416,6cyclictest31950-21latency23:54:060
24076992415,7cyclictest17368-21cut23:14:110
24076992415,7cyclictest17368-21cut23:14:110
142172240,3sleep30-21swapper/321:39:133
142172240,3sleep30-21swapper/321:39:133
24078992319,2cyclictest0-21swapper/121:04:031
24078992319,2cyclictest0-21swapper/121:04:031
24078992319,2cyclictest0-21swapper/119:34:141
24078992319,2cyclictest0-21swapper/119:34:141
24078992318,4cyclictest6176-21switchtime22:44:111
24078992318,4cyclictest6176-21switchtime22:44:111
24078992318,3cyclictest0-21swapper/120:24:091
24078992318,3cyclictest0-21swapper/120:24:091
24078992317,4cyclictest28139-21if_eth023:44:061
24078992317,4cyclictest28139-21if_eth023:44:061
24078992317,4cyclictest0-21swapper/123:54:061
24078992317,4cyclictest0-21swapper/123:54:061
24078992317,3cyclictest0-21swapper/120:04:131
24078992316,5cyclictest28108-21latency_hist22:18:531
24076992319,2cyclictest0-21swapper/022:49:120
24076992319,2cyclictest0-21swapper/022:49:120
24076992318,3cyclictest22419-21idleruntime-cro22:03:490
24076992318,3cyclictest22419-21idleruntime-cro22:03:490
24076992318,3cyclictest0-21swapper/000:14:060
24076992318,3cyclictest0-21swapper/000:14:060
24076992317,5cyclictest29709-21fschecks_count23:49:020
24076992317,5cyclictest29709-21fschecks_count23:49:020
24076992317,5cyclictest14348-21gltestperf00:34:050
24076992317,4cyclictest9811-21fschecks_time21:29:030
24076992317,4cyclictest22334-21fschecks_time23:29:040
24076992317,4cyclictest22334-21fschecks_time23:29:040
24076992316,6cyclictest3333-21sshd21:09:480
24076992316,5cyclictest8960-21missed_timers00:19:070
24076992316,5cyclictest8960-21missed_timers00:19:070
24076992316,5cyclictest25361-21sshd23:35:570
24076992316,5cyclictest12687-21netstat20:09:070
24076992316,5cyclictest12687-21netstat20:09:070
24076992315,6cyclictest16314-21cat21:44:110
24078992217,3cyclictest0-21swapper/120:49:041
24078992214,6cyclictest2975-21taskset19:44:041
24076992217,4cyclictest27875-21fschecks_count23:44:050
24076992217,4cyclictest27875-21fschecks_count23:44:050
24076992217,3cyclictest0-21swapper/021:49:080
24076992217,3cyclictest0-21swapper/021:49:080
24076992216,3cyclictest0-21swapper/023:09:140
24076992216,3cyclictest0-21swapper/023:09:140
24076992215,5cyclictest21894-21awk23:28:510
24076992213,7cyclictest22157-21processes20:34:110
66902210,3chrt0-21swapper/221:19:102
66902210,3chrt0-21swapper/221:19:102
24076992117,2cyclictest0-21swapper/019:39:140
24076992117,2cyclictest0-21swapper/019:39:140
24076992117,2cyclictest0-21swapper/019:39:140
24076992116,3cyclictest0-21swapper/023:04:110
278332200,4sleep3431rcuc/320:49:133
2408099207,10cyclictest32132-21chrt23:54:093
2408099207,10cyclictest32132-21chrt23:54:093
2408099203,11cyclictest0-21swapper/300:04:073
24076992015,3cyclictest0-21swapper/021:14:040
161572200,1sleep30-21swapper/300:39:033
161572200,1sleep30-21swapper/300:39:033
2408099191,14cyclictest26383-21chrt20:44:143
2408099191,14cyclictest26383-21chrt20:44:143
227402190,3sleep20-21swapper/223:29:072
227402190,3sleep20-21swapper/223:29:072
294892180,4sleep30-21swapper/322:19:133
294892180,4sleep30-21swapper/322:19:133
2407999182,11cyclictest13414-21chrt21:39:042
2407999182,11cyclictest13414-21chrt21:39:042
2407999181,13cyclictest25216-21chrt23:34:142
6412170,4sleep20-21swapper/223:58:502
6412170,4sleep20-21swapper/223:58:502
2408099171,12cyclictest0-21swapper/320:09:003
2408099171,12cyclictest0-21swapper/320:09:003
2407999171,12cyclictest4966-21chrt19:49:062
2407999171,11cyclictest7361-21chrt19:54:122
2407999171,11cyclictest26502-21chrt22:14:022
2407999171,10cyclictest16504-21chrt00:39:062
2407999171,10cyclictest16504-21chrt00:39:062
2407999170,12cyclictest10237-21chrt22:54:142
2408099163,9cyclictest0-21swapper/323:49:573
2408099163,9cyclictest0-21swapper/323:49:573
2408099163,9cyclictest0-21swapper/321:45:493
2408099163,9cyclictest0-21swapper/320:29:363
2408099163,9cyclictest0-21swapper/320:15:353
2408099163,9cyclictest0-21swapper/320:15:353
2408099163,8cyclictest0-21swapper/322:59:153
2408099163,8cyclictest0-21swapper/322:59:153
2408099163,10cyclictest0-21swapper/300:14:123
2408099163,10cyclictest0-21swapper/300:14:123
2408099162,9cyclictest10113-21chrt20:03:583
2407999162,9cyclictest0-21swapper/200:03:562
2407999162,9cyclictest0-21swapper/200:03:562
2407999162,9cyclictest0-21swapper/200:03:562
2407999161,8cyclictest0-21swapper/220:49:032
2407999161,11cyclictest8664-21chrt00:19:042
2407999161,11cyclictest8664-21chrt00:19:042
2407999161,11cyclictest14987-21chrt23:09:052
2407999161,11cyclictest14987-21chrt23:09:052
2407999161,11cyclictest0-21swapper/221:49:122
2407999161,11cyclictest0-21swapper/221:49:122
101272160,3sleep30-21swapper/320:04:023
2408099152,9cyclictest0-21swapper/321:50:523
2408099152,9cyclictest0-21swapper/321:50:523
2408099151,11cyclictest7521-21chrt19:54:133
2408099151,11cyclictest2975-21chrt19:44:043
2408099151,11cyclictest18433-21chrt23:19:033
2408099151,11cyclictest18433-21chrt23:19:033
2408099151,11cyclictest18433-21chrt23:19:033
2408099151,10cyclictest8815-21chrt00:19:053
2408099151,10cyclictest8815-21chrt00:19:053
2408099151,10cyclictest19432-21chrt20:28:553
2408099151,10cyclictest19432-21chrt20:28:553
24080991510,3cyclictest0-21swapper/319:37:093
24080991510,3cyclictest0-21swapper/319:37:093
2407999158,4cyclictest27622sleep221:09:102
2407999152,9cyclictest0-21swapper/222:50:572
2407999152,9cyclictest0-21swapper/222:50:572
2407999151,10cyclictest4064-21taskset22:39:102
2407999151,10cyclictest4064-21taskset22:39:102
2407999151,10cyclictest30739-21chrt22:24:072
2407999151,10cyclictest22769-21chrt22:04:052
2407999151,10cyclictest22769-21chrt22:04:052
2408099149,3cyclictest68522chrt22:48:483
2408099149,3cyclictest68522chrt22:48:483
2408099149,3cyclictest242132chrt22:07:403
2408099149,3cyclictest242132chrt22:07:403
2408099141,11cyclictest23325-21chrt20:39:043
2408099141,11cyclictest23325-21chrt20:39:043
2408099141,11cyclictest0-21swapper/321:29:063
2408099141,10cyclictest9584-21taskset22:54:073
2408099141,10cyclictest8214-21chrt21:24:063
2408099141,10cyclictest8214-21chrt21:24:063
2408099141,10cyclictest25284-21taskset22:09:083
2408099141,10cyclictest25284-21taskset22:09:083
2408099140,11cyclictest22375-21chrt23:29:043
2408099140,11cyclictest22375-21chrt23:29:043
2407999149,3cyclictest172522chrt20:22:142
2407999149,3cyclictest172522chrt20:22:142
2407999149,3cyclictest165162chrt21:44:512
2407999141,9cyclictest3881-21chrt19:44:152
2407999141,9cyclictest29667-21chrt23:49:012
2407999141,9cyclictest29667-21chrt23:49:012
2407999141,9cyclictest29541-21chrt22:19:202
2407999141,9cyclictest29541-21chrt22:19:202
2407999141,9cyclictest19624-21chrt21:54:082
2407999141,9cyclictest18799-21chrt23:19:062
2407999141,9cyclictest18799-21chrt23:19:062
2407999141,9cyclictest18799-21chrt23:19:062
2407999141,9cyclictest16772-21chrt23:14:042
2407999141,9cyclictest16772-21chrt23:14:042
2407999141,9cyclictest14888-21chrt00:34:122
2407999141,9cyclictest0-21swapper/223:44:572
2407999141,9cyclictest0-21swapper/223:44:572
2407999141,11cyclictest0-21swapper/221:28:522
2407999141,11cyclictest0-21swapper/221:28:522
2407999141,10cyclictest13202-21chrt23:04:032
2408099139,2cyclictest0-21swapper/323:17:143
2408099139,2cyclictest0-21swapper/323:17:143
2408099138,4cyclictest0-21swapper/321:57:443
2408099138,3cyclictest316762chrt22:27:293
2408099138,3cyclictest302482chrt20:56:043
2408099138,3cyclictest141992chrt23:06:333
2408099137,4cyclictest143192sleep300:34:053
2408099136,5cyclictest22112sleep321:09:033
2408099132,8cyclictest29592sleep322:37:153
2408099132,8cyclictest29592sleep322:37:153
2408099131,9cyclictest22093-21taskset20:34:093
2408099131,7cyclictest0-21swapper/321:34:013
2408099131,10cyclictest426-21chrt21:04:043
2408099131,10cyclictest426-21chrt21:04:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional