You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-08 - 14:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Jan 08, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2179999263,2cyclictest606-21dbus-daemon19:25:000
2180799241,22cyclictest4297-21cron23:00:012
2180799240,23cyclictest11023-21lockfile-create21:00:012
2181299230,22cyclictest0-21swapper/300:16:263
21807992321,1cyclictest0-21swapper/221:21:262
2180799231,21cyclictest1942-21sendmail00:00:002
2180799230,22cyclictest31781-21perf19:30:012
2180399231,21cyclictest21071-21grep21:20:011
21799992322,1cyclictest8973-21apt-get20:56:250
21799992320,3cyclictest131ksoftirqd/022:21:250
21799992320,2cyclictest6740-21perf23:05:010
2179999230,23cyclictest0-21swapper/023:56:270
2179999230,22cyclictest606-21dbus-daemon23:20:000
21812992220,1cyclictest1995-21sendmail-msp00:00:003
2181299220,21cyclictest3440-21apt-get21:51:283
21807992222,0cyclictest0-21swapper/219:36:262
21807992220,1cyclictest16763-21cron23:25:002
21807992220,1cyclictest0-21swapper/219:31:252
2180799220,21cyclictest0-21swapper/200:16:262
21803992221,1cyclictest12045-21apt-get00:21:261
21803992221,1cyclictest12045-21apt-get00:21:261
21803992220,1cyclictest606-21dbus-daemon00:00:001
21803992220,1cyclictest31786-21grep19:30:011
21803992219,2cyclictest3444-21idleruntime-cro20:45:001
2180399220,2cyclictest16799-21wc23:25:001
2180399220,21cyclictest0-21swapper/122:16:271
2180399220,1cyclictest6747-21awk23:05:011
2180399220,0cyclictest0-21swapper/123:41:261
2179999220,21cyclictest31760-21latency_hist19:30:010
2179999220,21cyclictest29946-21apt-get23:51:270
2179999220,21cyclictest0-21swapper/023:11:260
2179999220,21cyclictest0-21swapper/023:00:010
2179999220,21cyclictest0-21swapper/022:46:270
2179999220,21cyclictest0-21swapper/022:41:250
2179999220,21cyclictest0-21swapper/019:56:250
2179999220,21cyclictest0-21swapper/000:16:260
2179999220,21cyclictest0-21swapper/000:11:260
2179999220,1cyclictest5830-21apt-get21:56:250
2179999220,1cyclictest5830-21apt-get21:56:250
2179999220,1cyclictest0-21swapper/022:10:010
2179999220,1cyclictest0-21swapper/020:35:010
21812992121,0cyclictest0-21swapper/319:41:273
21812992121,0cyclictest0-21swapper/300:26:253
21812992121,0cyclictest0-21swapper/300:11:263
21812992120,1cyclictest26584-21apt-get19:20:023
21812992120,0cyclictest0-21swapper/321:11:263
21812992119,1cyclictest18880-21munin-run00:35:013
21812992119,1cyclictest0-21swapper/319:26:243
2181299210,21cyclictest0-21swapper/323:16:273
2181299210,21cyclictest0-21swapper/321:56:253
2181299210,21cyclictest0-21swapper/321:56:253
2181299210,20cyclictest0-21swapper/323:11:273
2181299210,1cyclictest4475-21perf00:05:003
2181299210,0cyclictest0-21swapper/321:16:253
21807992121,0cyclictest0-21swapper/223:11:272
21807992120,0cyclictest0-21swapper/222:11:262
21807992119,1cyclictest13839-21perf20:00:002
21807992119,1cyclictest0-21swapper/221:10:012
21807992118,2cyclictest7889-21turbostat22:00:012
21807992118,2cyclictest7889-21turbostat22:00:012
21807992118,2cyclictest28224-21apt20:30:012
2180799210,20cyclictest24763-21apt-get23:41:262
2180799210,20cyclictest0-21swapper/221:11:252
2180799210,20cyclictest0-21swapper/220:36:262
2180799210,1cyclictest23805-21apt-get20:21:242
21803992119,1cyclictest22329-21idleruntime-cro22:30:001
21803992119,1cyclictest0-21swapper/122:31:261
2180399210,20cyclictest0-21swapper/123:51:271
2180399210,1cyclictest11677-21perf00:20:011
2180399210,0cyclictest26584-21apt-get19:20:021
2180399210,0cyclictest0-21swapper/123:36:261
2180399210,0cyclictest0-21swapper/119:46:271
21799992121,0cyclictest0-21swapper/021:46:260
21799992121,0cyclictest0-21swapper/021:15:020
21799992121,0cyclictest0-21swapper/020:45:020
21799992121,0cyclictest0-21swapper/019:31:240
21799992120,0cyclictest0-21swapper/000:26:250
2179999210,20cyclictest14196-21apt-get20:01:240
2179999210,20cyclictest0-21swapper/019:51:250
2179999210,0cyclictest0-21swapper/020:21:240
21812992020,0cyclictest26199-21apt-get20:26:243
21812992020,0cyclictest22703-21apt-get22:31:263
21812992020,0cyclictest0-21swapper/323:41:263
21812992020,0cyclictest0-21swapper/322:51:273
21812992020,0cyclictest0-21swapper/322:26:263
21812992020,0cyclictest0-21swapper/321:06:263
21812992020,0cyclictest0-21swapper/321:01:253
21812992020,0cyclictest0-21swapper/320:56:253
2181299200,0cyclictest15485-21apt-get22:16:273
2181299200,0cyclictest0-21swapper/321:41:263
21807992020,0cyclictest0-21swapper/221:16:252
21807992020,0cyclictest0-21swapper/220:51:262
21807992019,1cyclictest7226-21apt-get00:11:262
21807992019,1cyclictest18987-21apt-get20:11:262
21807992019,1cyclictest0-21swapper/222:46:272
21807992018,1cyclictest0-21swapper/219:16:252
21807992017,2cyclictest313-21systemd-journal22:55:012
2180799200,20cyclictest0-21swapper/222:31:262
2180799200,20cyclictest0-21swapper/222:21:252
2180799200,20cyclictest0-21swapper/222:16:272
2180799200,0cyclictest0-21swapper/221:31:262
21803992020,0cyclictest4548-21apt-get19:41:271
21803992020,0cyclictest32305-21apt-get22:51:271
21803992020,0cyclictest17902-21apt-get22:21:251
21803992020,0cyclictest0-21swapper/121:31:261
21803992020,0cyclictest0-21swapper/120:21:241
21803992020,0cyclictest0-21swapper/119:36:261
21803992019,0cyclictest0-21swapper/120:36:261
21803992018,1cyclictest0-21swapper/122:50:011
2180399200,0cyclictest0-21swapper/122:11:261
2180399200,0cyclictest0-21swapper/100:01:271
21799992020,0cyclictest13837-21apt-get21:06:260
21799992020,0cyclictest0-21swapper/022:51:270
21799992020,0cyclictest0-21swapper/022:16:270
21799992020,0cyclictest0-21swapper/021:26:250
21799992020,0cyclictest0-21swapper/020:51:270
21799992020,0cyclictest0-21swapper/019:41:270
21799992018,1cyclictest20300-21chrt22:26:260
21799992018,1cyclictest19152-21cron23:30:010
2179999201,19cyclictest26466-21kworker/0:019:10:170
2179999200,0cyclictest18987-21apt-get20:11:260
21812991919,0cyclictest575-21apt-get20:40:023
21812991919,0cyclictest0-21swapper/323:26:273
21812991919,0cyclictest0-21swapper/320:31:263
21812991919,0cyclictest0-21swapper/320:16:263
21812991919,0cyclictest0-21swapper/300:06:263
21807991919,0cyclictest0-21swapper/223:45:022
21807991919,0cyclictest0-21swapper/223:16:272
21807991919,0cyclictest0-21swapper/220:40:022
21807991918,1cyclictest27511-21apt-get22:41:252
21807991918,1cyclictest10643-21apt-get22:06:262
21807991918,0cyclictest0-21swapper/219:11:262
21807991917,1cyclictest22346-21munin-run22:30:002
21807991917,1cyclictest18631-21perf20:10:002
2180799190,18cyclictest0-21swapper/222:05:012
21803991919,0cyclictest0-21swapper/123:11:271
21803991919,0cyclictest0-21swapper/122:56:281
21803991919,0cyclictest0-21swapper/121:21:261
21803991919,0cyclictest0-21swapper/121:11:251
21803991919,0cyclictest0-21swapper/121:06:261
21803991918,0cyclictest0-21swapper/119:31:251
21803991917,1cyclictest7880-21munin-run22:00:011
21803991917,1cyclictest7880-21munin-run22:00:011
21803991917,1cyclictest13846-21awk20:00:001
21803991917,1cyclictest10328-21sleep22:05:011
21803991917,1cyclictest0-21swapper/120:11:261
21803991917,1cyclictest0-21swapper/119:11:261
2180399190,18cyclictest606-21dbus-daemon23:50:011
21799991919,0cyclictest30994-21apt-get20:36:260
21799991919,0cyclictest13036-21apt-get22:11:260
21799991919,0cyclictest0-21swapper/022:31:260
21799991919,0cyclictest0-21swapper/021:36:250
21799991918,1cyclictest0-21swapper/022:36:260
2179999191,18cyclictest6445-21kworker/0:223:32:130
2179999191,18cyclictest6445-21kworker/0:223:23:170
2179999191,18cyclictest26466-21kworker/0:019:45:090
21812991818,0cyclictest6580-21apt-get20:51:273
21812991818,0cyclictest0-21swapper/323:46:283
21812991818,0cyclictest0-21swapper/323:06:243
21812991818,0cyclictest0-21swapper/322:41:253
21812991818,0cyclictest0-21swapper/319:46:273
21812991817,1cyclictest0-21swapper/320:06:253
21807991818,0cyclictest4833-21apt-get00:06:262
21807991818,0cyclictest0-21swapper/200:01:272
21807991816,1cyclictest6552-21cron19:45:012
21807991816,1cyclictest19902-21dump-pmu-power00:40:012
2180799180,17cyclictest28598-21apt-get20:31:262
21803991818,0cyclictest6580-21apt-get20:51:261
21803991816,1cyclictest26582-21turbostat.cron19:20:001
21803991816,1cyclictest0-21swapper/120:30:011
21799991818,0cyclictest0-21swapper/023:46:280
21799991818,0cyclictest0-21swapper/022:01:250
21799991818,0cyclictest0-21swapper/019:16:260
21799991818,0cyclictest0-21swapper/000:21:260
21799991818,0cyclictest0-21swapper/000:21:260
21799991817,1cyclictest16235-21apt-get21:11:250
2179999180,0cyclictest21444-21apt-get21:21:250
21812991717,0cyclictest0-21swapper/321:31:263
21812991717,0cyclictest0-21swapper/320:11:263
21812991717,0cyclictest0-21swapper/319:51:253
21812991717,0cyclictest0-21swapper/319:16:253
21812991716,1cyclictest30690-21dump-pmu-power21:40:003
21812991713,1cyclictest4707-21apt-get23:01:263
2181299170,14cyclictest0-21swapper/322:05:403
21807991717,0cyclictest0-21swapper/223:01:262
21807991717,0cyclictest0-21swapper/221:26:252
21807991717,0cyclictest0-21swapper/200:21:262
21807991717,0cyclictest0-21swapper/200:21:262
21807991716,1cyclictest27351-21apt-get19:21:262
21807991716,1cyclictest0-21swapper/223:31:252
21807991715,1cyclictest29946-21apt-get23:51:272
21803991717,0cyclictest0-21swapper/123:16:271
21803991717,0cyclictest0-21swapper/120:31:261
21803991717,0cyclictest0-21swapper/100:11:261
21803991715,1cyclictest18636-21munin-run20:10:001
21803991714,2cyclictest16226-21perf20:05:001
2180399170,2cyclictest21585-21dump-pmu-power23:35:011
2180399170,16cyclictest0-21swapper/100:40:011
21799991717,0cyclictest11389-21apt-get21:01:250
21799991717,0cyclictest0-21swapper/023:06:230
21799991717,0cyclictest0-21swapper/021:51:280
21799991717,0cyclictest0-21swapper/020:06:250
21799991717,0cyclictest0-21swapper/019:36:260
21799991717,0cyclictest0-21swapper/000:35:020
21799991716,1cyclictest605-21avahi-daemon20:20:010
21812991616,0cyclictest1029-21apt-get21:46:263
21812991616,0cyclictest0-21swapper/321:21:263
21812991615,1cyclictest8248-21apt-get22:01:253
21812991615,1cyclictest2131-21apt-get19:36:263
21812991614,1cyclictest622-21gdbus23:25:003
21812991614,1cyclictest4309-21sh23:00:013
2181299160,2cyclictest25820-21awk20:25:013
2181299160,14cyclictest0-21swapper/323:34:593
2181299160,14cyclictest0-21swapper/319:31:433
2181299160,0cyclictest0-21swapper/322:24:043
21807991616,0cyclictest9333-21apt-get19:51:252
21807991616,0cyclictest0-21swapper/221:51:282
21807991616,0cyclictest0-21swapper/221:01:252
21807991616,0cyclictest0-21swapper/220:01:242
21807991616,0cyclictest0-21swapper/200:31:282
21807991614,1cyclictest28638-21apt-get21:36:252
21803991616,0cyclictest0-21swapper/122:41:251
2180399160,15cyclictest9095-21sshd23:09:581
2179999163,7cyclictest24024-21gpgv23:40:010
21799991616,0cyclictest0-21swapper/023:41:260
21799991616,0cyclictest0-21swapper/000:06:260
21799991615,1cyclictest26244-21apt-get21:31:260
21812991515,0cyclictest0-21swapper/320:46:273
21812991515,0cyclictest0-21swapper/319:56:253
21812991514,1cyclictest22141-21apt-get19:11:263
21812991514,0cyclictest0-21swapper/323:51:273
2181299150,1cyclictest12469-21diskstats00:21:273
2181299150,1cyclictest12469-21diskstats00:21:273
2180799150,1cyclictest7741-21irqstats19:46:312
2180399158,6cyclictest606-21dbus-daemon21:51:351
21803991515,0cyclictest23845-21apt-get21:26:251
21803991515,0cyclictest0-21swapper/100:06:261
21803991513,1cyclictest311-21users21:41:361
21803991513,1cyclictest0-21swapper/119:51:261
2180399150,1cyclictest30378-21sshd21:36:391
2179999151,14cyclictest6445-21kworker/0:221:40:410
21812991414,0cyclictest0-21swapper/320:35:263
21812991414,0cyclictest0-21swapper/300:35:163
2181299140,14cyclictest0-21swapper/322:10:203
2181299140,0cyclictest0-21swapper/323:36:453
2181299140,0cyclictest0-21swapper/322:45:213
2181299140,0cyclictest0-21swapper/321:25:203
2181299140,0cyclictest0-21swapper/320:02:073
21807991414,0cyclictest0-21swapper/220:45:352
2180799140,14cyclictest0-21swapper/223:35:222
2180799140,14cyclictest0-21swapper/223:25:232
2180799140,14cyclictest0-21swapper/222:36:102
2180799140,14cyclictest0-21swapper/221:45:062
2180799140,14cyclictest0-21swapper/221:40:102
2180799140,14cyclictest0-21swapper/200:25:102
2180799140,0cyclictest0-21swapper/223:05:082
2180799140,0cyclictest0-21swapper/220:15:062
21803991414,0cyclictest0-21swapper/121:01:251
21803991414,0cyclictest0-21swapper/100:30:241
2180399140,14cyclictest0-21swapper/122:36:121
2180399140,14cyclictest0-21swapper/121:45:221
2180399140,14cyclictest0-21swapper/120:15:121
2180399140,14cyclictest0-21swapper/100:25:071
2180399140,0cyclictest0-21swapper/120:45:021
2179999140,14cyclictest0-21swapper/020:26:210
2179999140,0cyclictest0-21swapper/020:40:140
2179999140,0cyclictest0-21swapper/000:30:230
2179999140,0cyclictest0-21swapper/000:00:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional