You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-06 - 11:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Tue Jan 06, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15142992423,0cyclictest0-21swapper/320:31:153
15134992422,1cyclictest24746-21munin-run20:35:001
15142992322,1cyclictest0-21swapper/321:31:153
15142992322,1cyclictest0-21swapper/300:31:183
15142992320,2cyclictest9947-21perf20:05:013
15142992320,2cyclictest18885-21awk22:35:013
1514299230,22cyclictest27505-21apt-get20:41:163
1514299230,1cyclictest7109-21plymouth20:00:013
15137992321,1cyclictest0-21swapper/220:40:002
1513799230,22cyclictest9600-21awk21:10:012
1513799230,22cyclictest19895-21latency_hist19:20:012
15134992320,2cyclictest22287-21awk19:25:011
15134992320,1cyclictest313-21systemd-journal19:40:001
1513499230,22cyclictest2376-21latency_hist20:55:011
1514299220,21cyclictest27463-21cron19:35:013
1514299220,21cyclictest0-21swapper/320:16:153
1514299220,21cyclictest0-21swapper/319:46:153
1514299220,21cyclictest0-21swapper/319:11:163
1514299220,1cyclictest1230-21apt-get23:06:153
1514299220,1cyclictest0-21swapper/300:26:173
15137992221,1cyclictest30257-21apt-get19:41:172
15137992220,1cyclictest31600-21perf21:55:012
15137992220,1cyclictest25313-21apt-get19:30:022
1513799220,2cyclictest622-21gdbus20:35:002
1513799220,21cyclictest31261-21apt-get23:01:172
1513799220,21cyclictest18863-21cron22:35:012
1513799220,21cyclictest17152-21apt-get21:26:162
15134992221,1cyclictest6791-21apt-get22:11:181
15134992221,0cyclictest21658-21apt-get22:41:171
15134992220,1cyclictest7131-21cron20:00:011
15134992220,1cyclictest0-21swapper/121:55:011
1513499220,21cyclictest8442-21apt-get00:31:171
1513499220,21cyclictest3302-21perf00:20:011
1513499220,21cyclictest32649-21apt-get19:46:161
1513499220,21cyclictest24690-21apt-get19:30:021
1513499220,21cyclictest1230-21apt-get23:06:151
1513499220,21cyclictest0-21swapper/122:56:151
1513499220,21cyclictest0-21swapper/120:41:161
1513499220,21cyclictest0-21swapper/100:30:001
1513499220,0cyclictest0-21swapper/120:16:151
15132992220,1cyclictest17142-21perf20:20:010
15132992219,2cyclictest605-21avahi-daemon22:25:010
1513299220,21cyclictest32295-21grep19:45:000
1513299220,21cyclictest20293-21apt-get20:26:170
1513299220,21cyclictest19546-21apt-get21:31:140
1513299220,21cyclictest0-21swapper/022:12:440
1513299220,21cyclictest0-21swapper/022:06:160
1513299220,21cyclictest0-21swapper/022:01:160
1513299220,21cyclictest0-21swapper/021:16:150
1513299220,21cyclictest0-21swapper/020:01:160
1513299220,0cyclictest0-21swapper/000:06:160
15142992121,0cyclictest0-21swapper/321:36:173
15142992119,1cyclictest17781-21awk23:40:013
15142992119,1cyclictest0-21swapper/320:55:013
1514299210,20cyclictest0-21swapper/320:46:183
1514299210,20cyclictest0-21swapper/320:26:163
1514299210,20cyclictest0-21swapper/319:16:153
1514299210,1cyclictest24684-21perf19:30:013
1514299210,0cyclictest0-21swapper/322:06:163
15137992121,0cyclictest25695-21apt-get23:56:142
15137992120,1cyclictest20252-21apt-get19:21:132
15137992120,0cyclictest28208-21apt-get00:01:182
15137992120,0cyclictest27835-21apt-get19:36:142
15137992120,0cyclictest0-21swapper/220:26:172
15137992119,1cyclictest32349-21apt20:50:012
15137992119,1cyclictest0-21swapper/200:40:002
15137992118,2cyclictest29198-21wc21:50:012
1513799210,21cyclictest0-21swapper/222:46:142
1513799210,20cyclictest0-21swapper/222:21:172
1513799210,0cyclictest7146-21apt-get20:00:022
15134992121,0cyclictest24757-21apt-get21:41:161
15134992121,0cyclictest0-21swapper/121:35:021
15134992119,1cyclictest18512-21apt-get23:41:171
15134992119,1cyclictest12329-21apt-get21:16:151
1513499210,20cyclictest29541-21apt-get20:45:021
1513499210,20cyclictest17836-21apt-get19:16:151
1513499210,20cyclictest0-21swapper/122:16:151
1513499210,0cyclictest17506-21apt-get20:21:171
1513499210,0cyclictest0-21swapper/123:51:171
1513499210,0cyclictest0-21swapper/120:26:161
1513499210,0cyclictest0-21swapper/119:41:171
1513499210,0cyclictest0-21swapper/100:10:011
15132992121,0cyclictest8505-21apt-get23:21:160
15132992121,0cyclictest0-21swapper/019:36:130
15132992121,0cyclictest0-21swapper/000:01:190
15132992120,1cyclictest0-21swapper/023:36:160
15132992119,1cyclictest8121-21tr23:20:010
15132992119,1cyclictest16503-21munin-run22:30:010
1513299210,21cyclictest0-21swapper/021:11:170
1513299210,20cyclictest0-21swapper/023:26:160
1513299210,20cyclictest0-21swapper/021:41:160
1513299210,20cyclictest0-21swapper/019:21:130
1513299210,0cyclictest0-21swapper/022:46:140
15142992020,0cyclictest25086-21apt-get20:36:163
15142992020,0cyclictest0-21swapper/323:46:153
15142992020,0cyclictest0-21swapper/323:16:163
15142992020,0cyclictest0-21swapper/323:01:173
15142992020,0cyclictest0-21swapper/321:51:153
15142992020,0cyclictest0-21swapper/321:26:163
15142992020,0cyclictest0-21swapper/321:21:163
15142992020,0cyclictest0-21swapper/320:21:173
15142992020,0cyclictest0-21swapper/300:11:183
15142992019,0cyclictest0-21swapper/319:51:163
15142992017,2cyclictest0-21swapper/323:11:163
15142992016,3cyclictest27668-21tune2fs21:46:183
1514299200,20cyclictest0-21swapper/322:36:163
1514299200,0cyclictest0-21swapper/322:41:173
1514299200,0cyclictest0-21swapper/321:41:173
1514299200,0cyclictest0-21swapper/320:06:173
15137992020,0cyclictest2688-21apt-get19:51:162
15137992020,0cyclictest0-21swapper/220:21:172
15137992019,1cyclictest4396-21apt-get22:06:162
15137992019,1cyclictest17484-21latency_hist19:15:012
15137992019,0cyclictest15699-21apt-get23:36:172
15137992019,0cyclictest0-21swapper/221:31:152
1513799200,0cyclictest0-21swapper/222:36:152
1513799200,0cyclictest0-21swapper/221:41:172
15134992020,0cyclictest9939-21apt-get21:11:171
15134992020,0cyclictest31940-21apt-get21:56:161
15134992020,0cyclictest10900-21apt-get23:26:171
15134992020,0cyclictest0-21swapper/123:21:161
15134992020,0cyclictest0-21swapper/122:06:161
15134992020,0cyclictest0-21swapper/121:31:151
15134992020,0cyclictest0-21swapper/121:06:161
15134992020,0cyclictest0-21swapper/120:06:171
15134992020,0cyclictest0-21swapper/119:11:161
15134992020,0cyclictest0-21swapper/100:01:191
15134992019,1cyclictest19204-21perf21:30:001
1513499200,20cyclictest0-21swapper/120:56:151
1513499200,19cyclictest24687-21turbostat.cron19:30:011
15132992020,0cyclictest0-21swapper/023:11:160
15132992020,0cyclictest0-21swapper/023:01:170
15132992020,0cyclictest0-21swapper/022:16:160
15132992020,0cyclictest0-21swapper/021:56:160
15132992020,0cyclictest0-21swapper/021:36:170
15132992020,0cyclictest0-21swapper/020:11:160
15132992020,0cyclictest0-21swapper/019:46:150
15132992020,0cyclictest0-21swapper/000:31:170
15132992019,1cyclictest17119-21/usr/sbin/munin21:26:160
15132992018,1cyclictest15363-21munin-run23:35:010
1513299200,20cyclictest0-21swapper/020:36:160
1513299200,20cyclictest0-21swapper/019:16:150
1513299200,0cyclictest0-21swapper/023:46:150
1513299200,0cyclictest0-21swapper/023:40:030
1513299200,0cyclictest0-21swapper/022:56:150
1513299200,0cyclictest0-21swapper/020:46:170
1513299200,0cyclictest0-21swapper/019:31:150
1513299200,0cyclictest0-21swapper/000:21:170
15142991919,0cyclictest0-21swapper/322:21:173
15142991919,0cyclictest0-21swapper/321:56:163
15142991917,1cyclictest0-21swapper/321:15:003
15142991917,1cyclictest0-21swapper/300:21:253
15137991919,0cyclictest0-21swapper/223:46:152
15137991919,0cyclictest0-21swapper/223:41:162
15137991919,0cyclictest0-21swapper/223:31:162
15137991919,0cyclictest0-21swapper/200:31:172
15137991919,0cyclictest0-21swapper/200:06:162
15137991917,1cyclictest606-21dbus-daemon22:15:002
1513799190,18cyclictest17124-21tr20:20:012
1513799190,18cyclictest0-21swapper/219:26:162
1513799190,0cyclictest0-21swapper/219:46:152
15134991919,0cyclictest24049-21apt-get22:46:141
15134991919,0cyclictest0-21swapper/122:01:161
15134991919,0cyclictest0-21swapper/120:11:161
15134991919,0cyclictest0-21swapper/120:00:021
15134991917,1cyclictest27150-21apt-get21:46:161
15132991919,0cyclictest0-21swapper/023:56:140
15132991919,0cyclictest0-21swapper/020:56:150
15132991919,0cyclictest0-21swapper/020:51:160
15132991919,0cyclictest0-21swapper/020:41:160
15132991918,1cyclictest0-21swapper/021:25:000
15132991917,1cyclictest7178-21turbostat21:05:010
15142991818,0cyclictest28842-21apt-get22:56:153
15142991818,0cyclictest0-21swapper/323:26:173
15142991818,0cyclictest0-21swapper/323:21:163
15142991818,0cyclictest0-21swapper/319:36:143
15142991817,1cyclictest0-21swapper/323:40:023
15142991817,0cyclictest0-21swapper/322:46:143
15142991816,2cyclictest0-21swapper/321:06:233
15142991816,1cyclictest27750-21ls00:00:003
15142991816,1cyclictest0-21swapper/321:01:163
15142991816,1cyclictest0-21swapper/300:06:163
15142991810,7cyclictest0-21swapper/322:51:183
15137991818,0cyclictest26446-21apt-get22:51:162
15137991818,0cyclictest0-21swapper/223:26:172
15137991818,0cyclictest0-21swapper/221:56:162
15137991818,0cyclictest0-21swapper/200:21:172
15137991817,0cyclictest0-21swapper/223:11:162
15137991816,1cyclictest12347-21munin-run20:10:012
15137991816,1cyclictest0-21swapper/220:55:012
1513799180,18cyclictest0-21swapper/222:56:152
1513799180,17cyclictest12683-21apt-get20:11:162
15134991818,0cyclictest0-21swapper/123:36:171
15134991818,0cyclictest0-21swapper/122:20:021
15134991818,0cyclictest0-21swapper/120:36:161
15134991818,0cyclictest0-21swapper/100:21:171
15134991818,0cyclictest0-21swapper/100:11:181
15132991818,0cyclictest0-21swapper/021:51:150
15142991717,0cyclictest14442-21apt-get22:26:173
15142991717,0cyclictest0-21swapper/323:51:173
15142991717,0cyclictest0-21swapper/322:16:163
15142991717,0cyclictest0-21swapper/322:11:183
15142991717,0cyclictest0-21swapper/322:01:163
15142991717,0cyclictest0-21swapper/320:11:163
15142991717,0cyclictest0-21swapper/319:41:173
1514299170,17cyclictest0-21swapper/300:01:183
1514299170,16cyclictest11166-21cstates00:36:173
15137991717,0cyclictest5084-21apt-get19:56:172
15137991717,0cyclictest0-21swapper/223:21:162
15137991717,0cyclictest0-21swapper/222:41:172
15137991716,1cyclictest0-21swapper/222:16:162
15137991716,0cyclictest5147-21apt-get21:01:162
15134991717,0cyclictest0-21swapper/122:26:171
15134991717,0cyclictest0-21swapper/121:21:151
1513499170,0cyclictest3693-21apt-get23:11:161
1513299172,14cyclictest62550irq/127-eno119:26:160
15132991717,0cyclictest0-21swapper/020:06:160
15132991717,0cyclictest0-21swapper/000:26:170
15132991717,0cyclictest0-21swapper/000:11:180
15132991715,1cyclictest3304-21munin-run00:20:010
15132991715,1cyclictest21262-21cron22:40:010
15142991616,0cyclictest0-21swapper/323:31:163
15142991616,0cyclictest0-21swapper/321:16:153
1514299160,1cyclictest313-21systemd-journal00:20:013
15137991616,0cyclictest14748-21apt-get21:21:152
15137991616,0cyclictest0-21swapper/223:06:152
15134991616,0cyclictest13295-21apt-get23:31:161
15134991616,0cyclictest0-21swapper/122:51:161
15134991615,1cyclictest20908-21apt-get23:46:151
15134991614,1cyclictest8164-21munin-run23:20:011
1513499160,15cyclictest889-21perf23:05:001
15132991616,0cyclictest0-21swapper/023:06:150
15132991616,0cyclictest0-21swapper/022:51:160
15132991616,0cyclictest0-21swapper/022:41:170
15132991616,0cyclictest0-21swapper/020:21:180
15132991615,1cyclictest0-21swapper/023:51:170
15132991614,1cyclictest29211-21cut21:50:010
15132991614,1cyclictest0-21swapper/020:31:190
1513299160,15cyclictest17498-21munin-run19:15:010
15142991514,0cyclictest3370-21hddtemp_smartct20:56:183
15137991515,0cyclictest0-21swapper/222:01:162
15137991515,0cyclictest0-21swapper/220:41:162
15137991514,1cyclictest0-21swapper/221:15:002
1513799150,1cyclictest3268-21cron00:20:012
15142991414,0cyclictest0-21swapper/319:22:123
15137991414,0cyclictest0-21swapper/220:55:192
1513799140,14cyclictest0-21swapper/223:50:132
1513799140,14cyclictest0-21swapper/222:25:112
1513799140,14cyclictest0-21swapper/221:35:592
1513799140,14cyclictest0-21swapper/221:15:202
1513799140,14cyclictest0-21swapper/200:28:392
1513799140,14cyclictest0-21swapper/200:10:512
1513799140,0cyclictest0-21swapper/223:15:102
15134991414,0cyclictest0-21swapper/100:35:481
1513499140,14cyclictest0-21swapper/123:55:281
1513499140,14cyclictest0-21swapper/121:01:131
15132991414,0cyclictest0-21swapper/021:05:120
15132991414,0cyclictest0-21swapper/000:35:510
1513299140,14cyclictest0-21swapper/019:55:260
1513299140,0cyclictest0-21swapper/022:31:090
1513299140,0cyclictest0-21swapper/019:50:450
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional