You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-30 - 11:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Tue Dec 30, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2388421510,1sleep10-21swapper/123:40:141
5448212396,21sleep00-21swapper/019:08:020
5373211493,16sleep20-21swapper/219:07:042
52852113102,6sleep30-21swapper/319:05:573
5529210897,6sleep10-21swapper/119:09:031
46132850,0sleep10-21swapper/120:25:191
35322770,1sleep30-21swapper/322:02:363
115652740,1sleep00-21swapper/021:35:140
110282690,0sleep20-21swapper/200:01:472
40252670,0sleep10-21swapper/100:30:411
219822640,0sleep20-21swapper/223:37:382
563299280,10cyclictest0-21swapper/321:35:133
250282260,0sleep00-21swapper/000:18:360
563299230,2cyclictest0-21swapper/323:20:123
563099221,19cyclictest21888-21diskmemload22:50:121
563099220,20cyclictest0-21swapper/121:50:111
563099211,15cyclictest0-21swapper/122:34:041
563099210,19cyclictest0-21swapper/119:20:131
314882210,0sleep00-21swapper/021:20:150
563099201,14cyclictest0-21swapper/121:40:051
563299190,2cyclictest0-21swapper/321:15:123
563099192,15cyclictest0-21swapper/100:08:051
5630991916,2cyclictest21-21rcuc/120:50:131
563099191,13cyclictest0-21swapper/123:27:041
563099183,2cyclictest0-21swapper/122:21:031
563099183,2cyclictest0-21swapper/119:33:041
563099182,2cyclictest0-21swapper/122:19:051
5630991815,2cyclictest18536-21kworker/u8:122:25:031
563299171,14cyclictest25559-21aten2.4-expect23:05:123
563099173,2cyclictest0-21swapper/121:46:041
563099172,2cyclictest0-21swapper/123:50:041
563099172,14cyclictest0-21swapper/123:32:041
563099172,13cyclictest0-21swapper/122:36:041
5630991714,2cyclictest1503-21kworker/u8:300:37:031
563099171,2cyclictest0-21swapper/123:14:041
563099171,2cyclictest0-21swapper/123:07:051
563099171,2cyclictest0-21swapper/119:28:051
563099170,2cyclictest0-21swapper/100:04:041
563299160,14cyclictest0-21swapper/321:50:123
563299160,14cyclictest0-21swapper/320:50:133
563199161,3cyclictest9148-21python19:15:252
5631991613,2cyclictest19304-21kworker/u8:121:48:042
563199160,3cyclictest9391-21apt-get22:10:062
563099162,6cyclictest0-21swapper/100:16:531
563099162,2cyclictest0-21swapper/122:02:041
563099162,2cyclictest0-21swapper/100:24:041
5630991613,2cyclictest7859-21kworker/u8:223:21:041
5630991613,2cyclictest21881-21kworker/u8:023:38:041
563099161,2cyclictest0-21swapper/121:37:041
563099161,2cyclictest0-21swapper/121:23:041
563099161,2cyclictest0-21swapper/121:17:041
563099161,2cyclictest0-21swapper/121:00:041
563099161,2cyclictest0-21swapper/100:11:031
5630991612,2cyclictest7086-21sensors19:10:251
563099160,2cyclictest0-21swapper/120:46:041
563099160,2cyclictest0-21swapper/120:22:041
563099160,2cyclictest0-21swapper/119:38:051
563099160,13cyclictest0-21swapper/123:45:161
5629991613,2cyclictest19978-21kworker/u8:023:13:040
563299151,2cyclictest0-21swapper/300:13:303
5632991510,3cyclictest959-21taskset23:14:223
563199151,3cyclictest21543-21ssh22:23:112
5631991512,2cyclictest12206-21kworker/u8:221:26:052
563199151,12cyclictest21058-21apt-get23:00:112
5631991511,2cyclictest0-21swapper/200:35:182
5631991510,3cyclictest31297-21hddtemp_smartct21:20:132
563199150,3cyclictest30687-21needreboot23:10:172
563099152,2cyclictest0-21swapper/122:43:051
563099151,2cyclictest0-21swapper/123:19:041
563099151,2cyclictest0-21swapper/120:41:041
563099151,2cyclictest0-21swapper/120:41:031
563099151,2cyclictest0-21swapper/120:38:041
563099151,2cyclictest0-21swapper/120:38:041
5630991512,2cyclictest9190-21kworker/u8:122:47:031
5630991512,2cyclictest25607-21kworker/u8:120:11:031
5630991512,2cyclictest16158-21kworker/u8:021:09:041
563099151,12cyclictest0-21swapper/123:02:041
563099150,2cyclictest0-21swapper/121:56:171
563099150,2cyclictest0-21swapper/119:18:041
5629991511,2cyclictest30113-21swap21:55:270
5632991410,2cyclictest0-21swapper/323:31:293
563299140,3cyclictest0-21swapper/322:15:203
563299140,13cyclictest0-21swapper/321:30:123
563299140,12cyclictest26752-21ssh00:20:173
563299140,12cyclictest25444-21ssh22:27:223
563299140,12cyclictest2518-21ssh23:52:303
563299140,12cyclictest0-21swapper/323:55:173
563299140,12cyclictest0-21swapper/323:01:293
563299140,12cyclictest0-21swapper/322:45:173
563299140,12cyclictest0-21swapper/322:20:303
563299140,12cyclictest0-21swapper/321:20:083
563299140,12cyclictest0-21swapper/319:55:133
5631991411,2cyclictest32448-21kworker/u8:023:58:042
5631991411,2cyclictest24814-21kworker/u8:022:30:042
5631991411,2cyclictest14892-21kworker/u8:123:49:042
5631991411,2cyclictest0-21swapper/222:47:262
5631991410,2cyclictest25940-21munin-run20:00:002
563199140,3cyclictest16656-21cat21:40:182
563199140,2cyclictest21888-21diskmemload22:52:242
563199140,2cyclictest21888-21diskmemload21:15:462
563199140,13cyclictest0-21swapper/222:18:042
563199140,12cyclictest21888-21diskmemload21:14:442
563199140,12cyclictest0-21swapper/200:13:262
5630991411,2cyclictest0-21swapper/122:13:351
563099140,13cyclictest0-21swapper/119:40:141
5629991411,2cyclictest0-21swapper/000:36:270
562999141,11cyclictest28459-21fschecks_time23:45:140
562999140,2cyclictest21173-21munin-node0
562999140,2cyclictest0-21swapper/022:59:180
562999140,13cyclictest0-21swapper/022:28:170
562999140,12cyclictest23241-21ssh23:01:360
562999140,12cyclictest21888-21diskmemload00:22:470
562999140,12cyclictest0-21swapper/023:42:170
562999140,12cyclictest0-21swapper/023:26:570
47822140,2sleep00-21swapper/021:26:410
181982140,2sleep30-21swapper/321:42:033
563299132,6cyclictest21888-21diskmemload23:50:003
5632991310,2cyclictest0-21swapper/323:35:003
5632991310,2cyclictest0-21swapper/323:26:223
5632991310,2cyclictest0-21swapper/323:15:193
5632991310,2cyclictest0-21swapper/322:56:513
5632991310,2cyclictest0-21swapper/322:40:183
5632991310,2cyclictest0-21swapper/321:47:253
5632991310,2cyclictest0-21swapper/321:26:313
5632991310,2cyclictest0-21swapper/321:12:123
563299130,2cyclictest0-21swapper/323:40:553
563299130,2cyclictest0-21swapper/321:57:423
563299130,2cyclictest0-21swapper/300:35:463
563299130,2cyclictest0-21swapper/300:28:463
563299130,2cyclictest0-21swapper/300:05:013
563299130,12cyclictest2262-21ssh00:30:013
563299130,12cyclictest0-21swapper/322:50:193
563299130,12cyclictest0-21swapper/322:35:173
563299130,12cyclictest0-21swapper/319:45:133
563299130,12cyclictest0-21swapper/319:30:213
563299130,12cyclictest0-21swapper/300:03:203
5631991310,2cyclictest3573-21kworker/u8:222:42:052
5631991310,2cyclictest21888-21diskmemload23:33:332
5631991310,2cyclictest0-21swapper/223:50:342
5631991310,2cyclictest0-21swapper/223:15:242
5631991310,2cyclictest0-21swapper/222:25:362
5631991310,2cyclictest0-21swapper/221:31:332
5631991310,2cyclictest0-21swapper/200:30:552
5631991310,2cyclictest0-21swapper/200:07:042
563199130,2cyclictest0-21swapper/222:55:272
563199130,2cyclictest0-21swapper/222:37:062
563199130,2cyclictest0-21swapper/221:35:132
563199130,2cyclictest0-21swapper/219:25:152
563199130,2cyclictest0-21swapper/219:20:152
563199130,2cyclictest0-21swapper/200:28:542
563199130,12cyclictest7776-21ssh23:20:332
563199130,12cyclictest0-21swapper/223:25:532
563199130,12cyclictest0-21swapper/221:56:342
563199130,12cyclictest0-21swapper/220:00:262
563199130,12cyclictest0-21swapper/200:20:032
563199130,11cyclictest0-21swapper/220:50:172
563099139,2cyclictest12-21rcu_preempt19:55:131
563099132,7cyclictest0-21swapper/119:50:001
563099132,2cyclictest0-21swapper/120:02:051
5630991310,2cyclictest0-21swapper/122:05:121
5630991310,2cyclictest0-21swapper/121:30:361
5630991310,2cyclictest0-21swapper/120:15:181
5630991310,2cyclictest0-21swapper/120:05:131
563099130,2cyclictest0-21swapper/121:25:031
563099130,2cyclictest0-21swapper/120:55:031
563099130,12cyclictest0-21swapper/123:55:351
563099130,11cyclictest21888-21diskmemload22:59:111
563099130,11cyclictest0-21swapper/121:12:431
563099130,11cyclictest0-21swapper/119:50:201
562999138,3cyclictest25001-21ntpq19:55:170
5629991310,2cyclictest21888-21diskmemload22:20:190
5629991310,2cyclictest21888-21diskmemload00:10:140
5629991310,2cyclictest14390-21kworker/u8:221:43:050
5629991310,2cyclictest13101-21munin-node0
5629991310,2cyclictest0-21swapper/023:58:020
5629991310,2cyclictest0-21swapper/023:51:370
5629991310,2cyclictest0-21swapper/023:36:150
5629991310,2cyclictest0-21swapper/022:06:580
5629991310,2cyclictest0-21swapper/019:40:170
562999130,2cyclictest21888-21diskmemload22:45:190
562999130,2cyclictest0-21swapper/021:15:140
562999130,12cyclictest0-21swapper/020:25:170
563299129,2cyclictest0-21swapper/319:15:163
563299120,2cyclictest0-21swapper/322:30:083
563299120,2cyclictest0-21swapper/300:15:423
563299120,11cyclictest0-21swapper/322:11:183
563299120,11cyclictest0-21swapper/322:06:523
563299120,11cyclictest0-21swapper/320:35:173
563299120,11cyclictest0-21swapper/320:35:163
563299120,11cyclictest0-21swapper/319:25:143
563299120,11cyclictest0-21swapper/319:10:263
563199129,2cyclictest29234-21kworker/u8:122:03:042
563199129,2cyclictest0-21swapper/222:06:222
563199129,2cyclictest0-21swapper/220:25:182
563199120,2cyclictest0-21swapper/220:15:132
563199120,11cyclictest0-21swapper/223:41:562
563199120,11cyclictest0-21swapper/223:05:542
563199120,11cyclictest0-21swapper/220:57:142
563199120,11cyclictest0-21swapper/200:16:452
563099129,2cyclictest0-21swapper/100:25:071
562999129,2cyclictest0-21swapper/023:33:180
562999129,2cyclictest0-21swapper/023:20:590
562999129,2cyclictest0-21swapper/023:18:110
562999129,2cyclictest0-21swapper/022:50:230
562999129,2cyclictest0-21swapper/021:50:170
562999129,2cyclictest0-21swapper/021:32:040
562999129,2cyclictest0-21swapper/000:00:100
562999120,2cyclictest21888-21diskmemload22:34:200
562999120,2cyclictest0-21swapper/021:46:520
562999120,2cyclictest0-21swapper/000:30:420
562999120,11cyclictest0-21swapper/022:16:170
562999120,11cyclictest0-21swapper/022:03:230
562999120,11cyclictest0-21swapper/021:10:010
562999120,11cyclictest0-21swapper/020:50:120
562999120,11cyclictest0-21swapper/000:26:350
45772121,8sleep04653-21ssh22:40:250
236412120,2sleep00-21swapper/019:51:340
8462110,2sleep0856-21ssh22:35:520
563299112,7cyclictest0-21swapper/319:21:593
563299112,6cyclictest0-21swapper/319:38:593
563199118,2cyclictest0-21swapper/221:50:252
563199118,2cyclictest0-21swapper/220:20:162
562999118,2cyclictest0-21swapper/023:06:310
562999118,2cyclictest0-21swapper/020:35:130
562999118,2cyclictest0-21swapper/020:35:130
562999110,1cyclictest0-21swapper/022:11:370
562999110,10cyclictest25607-21kworker/u8:120:00:050
562999110,10cyclictest12140-21kworker/u8:019:47:030
563299107,2cyclictest0-21swapper/321:05:253
563299107,2cyclictest0-21swapper/321:00:193
563299105,3cyclictest30762-21http_loadtime20:10:173
563299105,3cyclictest20069-21cat19:45:003
563299102,6cyclictest0-21swapper/320:45:253
563299101,5cyclictest0-21swapper/321:00:003
563299101,2cyclictest29954-21cron20:10:003
563299100,1cyclictest0-21swapper/320:30:093
563199107,2cyclictest0-21swapper/219:10:332
563199105,3cyclictest21883-21sh21:10:002
563199100,9cyclictest0-21swapper/220:41:322
563199100,9cyclictest0-21swapper/220:41:322
563199100,2cyclictest0-21swapper/219:45:542
563099100,8cyclictest0-21swapper/120:30:101
562999107,2cyclictest0-21swapper/020:45:250
562999107,2cyclictest0-21swapper/020:20:140
562999107,2cyclictest0-21swapper/020:05:170
189882100,7sleep20-21swapper/219:40:172
7662290,2sleep00-21swapper/019:13:070
56329996,2cyclictest0-21swapper/319:50:173
56329994,3cyclictest7458-21runrttasks20:22:283
56329994,3cyclictest11255-21timerandwakeup20:40:273
56329994,3cyclictest11255-21timerandwakeup20:40:263
56329994,3cyclictest0-21swapper/320:25:153
56329992,6cyclictest0-21swapper/320:15:243
56329991,6cyclictest0-21swapper/320:00:233
56319994,4cyclictest19847-21seq21:04:442
56319994,3cyclictest8856-21needreboot20:35:192
56319994,3cyclictest8856-21needreboot20:35:182
56319994,3cyclictest7458-21runrttasks20:31:402
56319994,3cyclictest7458-21runrttasks19:54:212
56319994,3cyclictest28909-21latency20:05:162
56319994,3cyclictest17869-21cron19:40:012
56319994,3cyclictest14575-21fschecks_time19:30:152
56299993,2cyclictest0-21swapper/019:25:000
56299990,8cyclictest12206-21kworker/u8:221:02:040
56299990,2cyclictest0-21swapper/019:30:170
56319984,3cyclictest30271-21aten2.4-expect20:10:142
56319984,3cyclictest12106-21aten2.4-expect20:45:142
56299984,3cyclictest8721-21cut19:15:170
56299984,2cyclictest16950-21ntp_offset20:55:180
56299983,3cyclictest6094-21tr20:30:110
56299982,5cyclictest26059-21kworker/0:020:40:270
56299982,5cyclictest26059-21kworker/0:020:40:260
56299981,6cyclictest26059-21kworker/0:020:10:150
56299980,2cyclictest0-21swapper/020:15:120
56299980,2cyclictest0-21swapper/019:28:380
56299973,3cyclictest16192-21basename19:35:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional