You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-01 - 15:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Jan 01, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25258211795,16sleep30-21swapper/307:09:383
23668211795,14sleep20-21swapper/207:05:132
249782116105,6sleep10-21swapper/107:06:001
25230211187,19sleep00-21swapper/007:09:150
1515121050,0sleep00-21swapper/009:53:200
97602800,0sleep30-21swapper/310:24:243
199712740,1sleep00-21swapper/009:20:520
28732710,0sleep20-21swapper/211:30:132
153902700,0sleep20-21swapper/209:15:252
128172700,0sleep00-21swapper/009:13:340
29722670,1sleep30-21swapper/310:15:263
25762620,1sleep00-21swapper/008:50:270
25323993617,18cyclictest0-21swapper/209:50:122
263232280,2sleep1221ktimersoftd/110:05:221
2531899260,16cyclictest0-21swapper/011:15:100
194712260,1sleep0101ktimersoftd/011:49:150
2531899251,22cyclictest0-21swapper/010:45:130
2532399220,17cyclictest0-21swapper/210:38:042
2531899222,6cyclictest0-21swapper/010:20:010
2531899212,6cyclictest0-21swapper/008:50:000
25323992017,2cyclictest11175-21kworker/u8:011:16:052
2532399192,2cyclictest0-21swapper/212:31:032
2532399192,2cyclictest0-21swapper/212:17:052
25323991916,2cyclictest6524-21kworker/u8:107:10:042
25323991916,2cyclictest24107-21kworker/u8:212:12:042
25323991916,2cyclictest18541-21kworker/u8:212:37:042
25323991916,2cyclictest13394-21kworker/u8:111:51:042
25323991916,2cyclictest11175-21kworker/u8:011:08:042
2532499181,3cyclictest0-21swapper/312:36:303
25323991815,2cyclictest7649-21kworker/u8:109:11:042
25323991815,2cyclictest26254-21kworker/u8:110:45:042
25323991815,2cyclictest2229-21kworker/u8:009:39:042
25323991815,2cyclictest21177-21kworker/u8:111:20:042
25323991815,2cyclictest21143-21kworker/u8:209:31:042
25323991815,2cyclictest16419-21kworker/u8:010:34:042
25323991815,2cyclictest11175-21kworker/u8:011:38:042
2532399180,13cyclictest0-21swapper/212:28:042
2532399180,13cyclictest0-21swapper/212:04:042
25323991714,2cyclictest9496-21kworker/u8:208:15:052
25323991714,2cyclictest6524-21kworker/u8:107:23:042
25323991714,2cyclictest3916-21kworker/u8:010:22:042
25323991714,2cyclictest3916-21kworker/u8:010:18:042
25323991714,2cyclictest26261-21kworker/u8:211:28:042
25323991714,2cyclictest25219-21kworker/u8:110:27:042
25323991714,2cyclictest16419-21kworker/u8:010:42:042
25323991714,2cyclictest16265-21kworker/u8:109:20:042
25323991714,2cyclictest13629-21kworker/u8:112:20:042
25323991714,2cyclictest13394-21kworker/u8:111:57:042
25323991714,2cyclictest11896-21kworker/u8:009:26:042
25323991714,2cyclictest11175-21kworker/u8:011:41:042
2532399170,2cyclictest19923-21ssh09:59:032
2532399170,12cyclictest0-21swapper/207:45:042
2532199170,15cyclictest0-21swapper/110:38:211
149952170,1sleep00-21swapper/011:44:020
25324991613,2cyclictest13394-21kworker/u8:111:42:043
25323991613,2cyclictest23736-21kworker/u8:208:42:042
25323991613,2cyclictest19246-21kworker/u8:210:12:042
25323991613,2cyclictest19246-21kworker/u8:210:07:032
2532399160,15cyclictest0-21swapper/209:48:042
2531899161,3cyclictest0-21swapper/011:35:130
2531899160,3cyclictest6000-21wc12:10:180
2531899160,14cyclictest0-21swapper/010:30:480
2532499151,3cyclictest0-21swapper/312:10:153
25324991512,2cyclictest26254-21kworker/u8:110:44:043
25324991512,2cyclictest24107-21kworker/u8:212:16:053
25324991512,2cyclictest2229-21kworker/u8:009:40:043
25324991512,2cyclictest21455-21kworker/u8:210:49:033
25324991512,2cyclictest19246-21kworker/u8:209:58:043
25324991512,2cyclictest11896-21kworker/u8:009:19:043
25324991512,2cyclictest0-21swapper/310:50:403
25324991512,2cyclictest0-21swapper/310:03:413
2532499150,2cyclictest0-21swapper/309:38:013
25323991512,2cyclictest2842-21kworker/u8:107:40:042
25323991512,2cyclictest27310-21kworker/u8:108:32:042
2532399150,13cyclictest0-21swapper/207:51:102
2532399150,11cyclictest0-21swapper/211:14:042
2532199150,13cyclictest7518-21latency_hist09:05:001
2532199150,13cyclictest0-21swapper/109:14:061
2531899151,7cyclictest0-21swapper/007:45:010
2531899150,13cyclictest21063-21cpuspeed_turbos10:00:150
25324991411,2cyclictest3099-21kworker/u8:012:22:053
25324991411,2cyclictest26254-21kworker/u8:110:59:043
25324991411,2cyclictest23736-21kworker/u8:208:40:043
25324991411,2cyclictest21177-21kworker/u8:111:19:033
25324991411,2cyclictest11175-21kworker/u8:011:36:043
25324991411,2cyclictest0-21swapper/311:06:003
25324991411,2cyclictest0-21swapper/309:48:503
25324991410,2cyclictest0-21swapper/311:10:473
25324991410,2cyclictest0-21swapper/310:35:233
2532499140,2cyclictest0-21swapper/309:33:403
2532499140,1cyclictest9410-21diskmemload09:29:203
2532499140,13cyclictest0-21swapper/312:26:303
2532499140,13cyclictest0-21swapper/310:25:103
25323991411,2cyclictest32393-21kworker/u8:010:55:042
25323991411,2cyclictest31590-21kworker/u8:207:25:052
25323991411,2cyclictest27564-21kworker/u8:007:16:042
25323991411,2cyclictest23736-21kworker/u8:209:00:042
25323991411,2cyclictest23736-21kworker/u8:208:56:042
25323991411,2cyclictest23736-21kworker/u8:208:51:042
25323991411,2cyclictest19833-21kworker/u8:008:26:042
25323991411,2cyclictest15227-21kworker/u8:108:20:042
2532399140,9cyclictest0-21swapper/208:12:042
2532399140,2cyclictest0-21swapper/212:07:042
2532399140,2cyclictest0-21swapper/211:48:042
25321991411,2cyclictest9410-21diskmemload11:55:541
25321991411,2cyclictest9410-21diskmemload10:29:101
25321991411,2cyclictest0-21swapper/112:21:211
25321991411,2cyclictest0-21swapper/111:37:091
25321991411,2cyclictest0-21swapper/111:20:001
25321991411,2cyclictest0-21swapper/111:14:041
25321991411,2cyclictest0-21swapper/109:23:161
25321991411,2cyclictest0-21swapper/109:17:291
2532199140,13cyclictest9410-21diskmemload09:52:101
2532199140,13cyclictest0-21swapper/112:02:391
2532199140,12cyclictest9410-21diskmemload11:28:131
2532199140,12cyclictest9410-21diskmemload10:45:211
2532199140,12cyclictest0-21swapper/111:06:001
2532199140,12cyclictest0-21swapper/110:40:151
2532199140,12cyclictest0-21swapper/109:48:311
2531899149,3cyclictest24576-21ssh09:26:270
2531899142,7cyclictest0-21swapper/012:00:000
2531899141,7cyclictest13904-21copy12:20:010
2531899141,2cyclictest9410-21diskmemload11:31:270
25318991411,2cyclictest0-21swapper/012:37:580
25318991411,2cyclictest0-21swapper/010:56:580
25318991411,2cyclictest0-21swapper/009:41:080
2531899140,7cyclictest0-21swapper/012:34:020
2531899140,2cyclictest0-21swapper/010:13:080
2531899140,13cyclictest0-21swapper/012:05:180
25324991310,2cyclictest9496-21kworker/u8:207:55:043
25324991310,2cyclictest26254-21kworker/u8:111:00:043
25324991310,2cyclictest25869-21apt-get11:20:053
25324991310,2cyclictest2481-21ssh12:05:373
25324991310,2cyclictest21143-21kworker/u8:209:23:043
2532499130,12cyclictest0-21swapper/311:45:093
2532499130,11cyclictest0-21swapper/311:55:183
2532499130,11cyclictest0-21swapper/311:30:413
2532499130,11cyclictest0-21swapper/310:30:593
25323991310,2cyclictest31590-21kworker/u8:207:30:042
2532399130,11cyclictest23662-21ssh10:02:472
25321991310,2cyclictest9410-21diskmemload10:01:361
25321991310,2cyclictest9410-21diskmemload09:41:161
25321991310,2cyclictest9410-21diskmemload09:36:571
25321991310,2cyclictest0-21swapper/111:51:281
25321991310,2cyclictest0-21swapper/111:45:281
25321991310,2cyclictest0-21swapper/111:42:391
25321991310,2cyclictest0-21swapper/111:15:211
25321991310,2cyclictest0-21swapper/110:57:351
25321991310,2cyclictest0-21swapper/110:30:121
25321991310,2cyclictest0-21swapper/110:15:001
25321991310,2cyclictest0-21swapper/109:30:091
25321991310,2cyclictest0-21swapper/109:25:451
25321991310,2cyclictest0-21swapper/108:20:171
25321991310,2cyclictest0-21swapper/107:10:181
2532199130,3cyclictest5538-21cut12:10:151
2532199130,2cyclictest9410-21diskmemload12:37:191
2532199130,2cyclictest0-21swapper/112:31:331
2532199130,2cyclictest0-21swapper/112:05:501
2532199130,2cyclictest0-21swapper/111:30:071
2532199130,12cyclictest0-21swapper/112:25:291
2532199130,12cyclictest0-21swapper/112:15:361
2532199130,12cyclictest0-21swapper/111:00:131
2532199130,12cyclictest0-21swapper/110:51:421
2532199130,12cyclictest0-21swapper/110:20:081
2532199130,12cyclictest0-21swapper/110:11:211
2532199130,11cyclictest0-21swapper/108:15:221
2531899138,3cyclictest11474-21pzem_energy10:25:200
2531899132,6cyclictest0-21swapper/009:55:010
2531899132,6cyclictest0-21swapper/009:45:000
25318991310,2cyclictest9410-21diskmemload11:50:140
25318991310,2cyclictest0-21swapper/011:11:080
25318991310,2cyclictest0-21swapper/009:15:470
2531899130,4cyclictest961-21xargs07:30:000
2531899130,3cyclictest12308-21ssh11:04:150
2531899130,2cyclictest9410-21diskmemload12:15:160
2531899130,2cyclictest0-21swapper/011:09:590
2531899130,2cyclictest0-21swapper/008:10:120
2531899130,12cyclictest0-21swapper/011:20:080
2531899130,12cyclictest0-21swapper/008:25:180
2531899130,11cyclictest9410-21diskmemload09:35:260
2531899130,11cyclictest9410-21diskmemload09:30:160
2531899130,11cyclictest0-21swapper/010:06:290
2532499129,2cyclictest23736-21kworker/u8:209:06:043
2532499129,2cyclictest23736-21kworker/u8:209:06:043
2532499129,2cyclictest0-21swapper/309:12:313
2532499120,2cyclictest0-21swapper/311:25:403
2532499120,11cyclictest0-21swapper/312:00:123
2532499120,10cyclictest0-21swapper/312:30:373
2532499120,10cyclictest0-21swapper/311:50:053
2532499120,10cyclictest0-21swapper/309:52:043
2532399129,2cyclictest0-21swapper/211:00:222
2532399129,2cyclictest0-21swapper/208:00:122
2532399126,4cyclictest277-21jbd2/sda1-809:40:262
2532399122,7cyclictest0-21swapper/208:08:012
2532399120,11cyclictest0-21swapper/210:50:172
2532199129,2cyclictest0-21swapper/109:55:441
2532199129,2cyclictest0-21swapper/108:45:221
2532199129,2cyclictest0-21swapper/108:31:401
2532199129,2cyclictest0-21swapper/107:15:211
2532199120,2cyclictest0-21swapper/108:35:221
2532199120,2cyclictest0-21swapper/108:00:161
2532199120,11cyclictest0-21swapper/109:05:141
2532199120,11cyclictest0-21swapper/109:05:131
2532199120,11cyclictest0-21swapper/107:34:581
2531899129,2cyclictest9410-21diskmemload12:26:220
2531899129,2cyclictest0-21swapper/011:27:360
2531899129,2cyclictest0-21swapper/010:41:060
2531899129,2cyclictest0-21swapper/010:35:380
2531899129,2cyclictest0-21swapper/008:40:190
2531899129,2cyclictest0-21swapper/008:20:180
2531899127,3cyclictest469-21iostat10:50:170
2531899127,3cyclictest13921-21tr08:00:130
2531899122,7cyclictest9410-21diskmemload12:05:000
2531899122,7cyclictest0-21swapper/008:05:590
2531899122,7cyclictest0-21swapper/007:48:010
2531899120,2cyclictest9410-21diskmemload10:20:450
2531899120,11cyclictest0-21swapper/008:30:130
2532499118,2cyclictest19246-21kworker/u8:210:14:043
2532499118,2cyclictest13121-21kworker/u8:008:01:053
2532499111,8cyclictest18363-21taskset08:10:153
2532399110,10cyclictest0-21swapper/208:45:282
2532199118,2cyclictest0-21swapper/108:05:151
2532199110,9cyclictest3396-21apt-get08:55:111
2532199110,3cyclictest7430-21munin-node1
2532199110,2cyclictest0-21swapper/107:25:221
2531899118,2cyclictest0-21swapper/007:35:170
2531899118,2cyclictest0-21swapper/007:20:100
2531899110,10cyclictest0-21swapper/009:00:150
2532499107,2cyclictest27564-21kworker/u8:007:41:043
2532499107,2cyclictest27564-21kworker/u8:007:27:043
2532499107,2cyclictest27564-21kworker/u8:007:17:043
2532499107,2cyclictest27310-21kworker/u8:108:34:043
2532499107,2cyclictest15227-21kworker/u8:108:06:043
2532499105,3cyclictest6528-21ntpd10:05:163
2532499105,3cyclictest25543-21apt-get07:10:053
2532499105,3cyclictest24054-21df08:25:153
2532499100,2cyclictest0-21swapper/308:17:493
2532399102,5cyclictest0-21swapper/209:06:582
2532399102,5cyclictest0-21swapper/209:06:582
2532399100,9cyclictest0-21swapper/207:37:042
2532399100,7cyclictest0-21swapper/208:37:012
2532199107,2cyclictest9458-21munin-node1
2532199100,8cyclictest0-21swapper/107:20:121
2532199100,6cyclictest25802timerandwakeup08:50:271
2532199100,2cyclictest13615-21cat08:00:001
2531899107,2cyclictest0-21swapper/008:35:190
2531899100,2cyclictest0-21swapper/007:50:250
253249994,3cyclictest7990-21fschecks_time07:45:133
253249994,3cyclictest32729-21ntpq08:45:173
253249994,3cyclictest3205-21apt-config07:35:013
253249994,3cyclictest29332sleep308:52:043
253249994,3cyclictest10767-21sed07:50:253
253249994,3cyclictest0-21swapper/307:30:163
253249993,4cyclictest6528-21ntpd09:00:183
253249993,4cyclictest29731-21aten2.4_r3power07:20:123
253249991,3cyclictest0-21swapper/308:55:163
253249991,3cyclictest0-21swapper/308:20:123
253239994,3cyclictest11894-21grep07:55:102
253219996,2cyclictest0-21swapper/108:40:131
253219990,8cyclictest0-21swapper/107:40:101
253219990,2cyclictest3228-21munin-node1
253189994,3cyclictest49692sleep008:57:170
253189994,3cyclictest25540-21gdbus07:10:040
253189994,3cyclictest126582chrt07:55:180
253189993,4cyclictest29548-21latency_hist07:20:010
253189990,2cyclictest0-21swapper/007:30:160
19929290,1sleep0101ktimersoftd/008:15:130
253249983,3cyclictest28443-21iostat_ios08:35:173
253219980,2cyclictest23811-21aten2.4-expect08:25:131
253219980,2cyclictest0-21swapper/108:10:111
253189983,3cyclictest7826-21cpuspeed_turbos09:05:120
253189983,3cyclictest7826-21cpuspeed_turbos09:05:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional