You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 05:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Mon Mar 30, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14114211695,16sleep20-21swapper/219:05:342
14727211591,18sleep00-21swapper/019:08:070
14595211594,16sleep30-21swapper/319:06:273
14780211396,12sleep10-21swapper/119:08:481
218012750,0sleep10-21swapper/123:14:541
163472720,0sleep10-21swapper/123:41:421
64612710,0sleep20-21swapper/221:50:282
299922710,0sleep30-21swapper/323:22:373
37232690,0sleep00-21swapper/022:55:120
37232690,0sleep00-21swapper/022:55:120
136992690,1sleep2301ktimersoftd/221:58:382
27442550,1sleep00-21swapper/000:35:160
14900993817,19cyclictest31032-21diskmemload21:35:101
1490199370,2cyclictest0-21swapper/219:25:122
250522300,1sleep00-21swapper/020:54:590
111272290,0sleep10-21swapper/122:29:551
308882270,0sleep10-21swapper/121:42:341
80802230,0sleep10-21swapper/121:19:331
313682220,1sleep10-21swapper/122:16:101
1489999221,19cyclictest0-21swapper/020:55:100
1490299200,2cyclictest0-21swapper/322:00:123
1490199200,18cyclictest0-21swapper/221:10:122
314162190,0sleep20-21swapper/222:50:142
254922190,0sleep00-21swapper/000:25:140
1490299182,15cyclictest0-21swapper/321:09:043
1490299180,3cyclictest0-21swapper/323:32:043
1489999182,6cyclictest0-21swapper/022:38:580
1490299172,2cyclictest0-21swapper/321:19:043
1490299171,2cyclictest0-21swapper/319:18:043
1490299170,7cyclictest0-21swapper/321:59:013
1490299170,3cyclictest0-21swapper/322:06:013
1490299170,1cyclictest0-21swapper/319:47:043
1490299162,2cyclictest0-21swapper/320:40:043
1490299162,12cyclictest0-21swapper/322:57:053
1490299162,12cyclictest0-21swapper/322:57:043
1490299161,2cyclictest0-21swapper/320:27:043
1490299161,2cyclictest0-21swapper/319:20:043
1490299160,3cyclictest0-21swapper/300:31:043
1490299160,2cyclictest0-21swapper/320:45:053
1490099167,7cyclictest4562-21gdm-simple-gree21:21:581
14900991611,3cyclictest7671-21taskset23:33:091
1490099161,13cyclictest0-21swapper/123:35:051
1490099160,2cyclictest0-21swapper/123:21:591
1489999160,14cyclictest0-21swapper/020:15:120
1490299152,2cyclictest0-21swapper/300:17:043
1490299150,3cyclictest0-21swapper/322:52:033
14901991512,2cyclictest0-21swapper/223:08:102
1490199150,13cyclictest11534-21munin-node2
1490099151,12cyclictest0-21swapper/122:52:351
1490099151,12cyclictest0-21swapper/121:32:051
1490099150,13cyclictest29813-21hddtemp_smartct21:05:151
1490099150,13cyclictest0-21swapper/122:03:041
1490099150,13cyclictest0-21swapper/121:45:191
1490099150,13cyclictest0-21swapper/119:35:171
1490099150,13cyclictest0-21swapper/100:01:201
1489999151,3cyclictest24551-21sh21:35:500
1489999151,12cyclictest8024-21ssh23:33:430
14899991511,2cyclictest22325-21kworker/u8:023:03:050
14899991510,3cyclictest24558-21ssh22:43:200
14899991510,3cyclictest0-21swapper/020:30:140
1489999150,13cyclictest0-21swapper/000:07:080
112012150,1sleep011202-21ssh21:21:520
1490299141,2cyclictest0-21swapper/323:56:043
14902991410,2cyclictest0-21swapper/323:15:133
1490299140,12cyclictest0-21swapper/321:00:153
1490199141,2cyclictest21241-21ssh22:40:122
14901991411,2cyclictest0-21swapper/222:00:112
14901991411,2cyclictest0-21swapper/219:20:112
14901991411,2cyclictest0-21swapper/200:18:012
14901991410,2cyclictest0-21swapper/220:00:122
14901991410,2cyclictest0-21swapper/219:56:022
1490199140,2cyclictest24110-21ssh22:09:502
1490199140,13cyclictest0-21swapper/223:51:212
1490199140,13cyclictest0-21swapper/223:11:512
1490199140,13cyclictest0-21swapper/200:27:322
1490199140,12cyclictest6182-21mailstats20:05:592
1490199140,12cyclictest0-21swapper/200:23:582
1490099149,3cyclictest0-21swapper/123:51:531
1490099143,2cyclictest0-21swapper/122:55:171
1490099143,2cyclictest0-21swapper/122:55:171
1490099142,7cyclictest31032-21diskmemload00:35:001
1490099142,7cyclictest0-21swapper/119:45:011
1490099142,6cyclictest0-21swapper/122:45:001
1490099142,6cyclictest0-21swapper/120:44:591
1490099142,6cyclictest0-21swapper/120:20:001
1490099142,6cyclictest0-21swapper/119:15:001
14900991411,2cyclictest0-21swapper/123:05:181
14900991411,2cyclictest0-21swapper/123:00:581
14900991411,2cyclictest0-21swapper/100:16:191
1490099140,2cyclictest0-21swapper/123:56:081
1490099140,13cyclictest0-21swapper/122:34:281
1490099140,12cyclictest31032-21diskmemload22:38:091
1490099140,12cyclictest22533-21chrt22:40:471
1490099140,12cyclictest0-21swapper/122:11:421
1489999141,2cyclictest19150-21apt-get19:20:110
14899991410,2cyclictest0-21swapper/020:10:150
1489999140,2cyclictest0-21swapper/023:50:050
1489999140,2cyclictest0-21swapper/000:20:180
1489999140,12cyclictest17773-21ssh22:02:270
1489999140,12cyclictest0-21swapper/022:20:500
203292130,2sleep30-21swapper/323:12:353
1490299132,10cyclictest0-21swapper/320:14:053
14902991310,2cyclictest0-21swapper/320:15:173
1490299130,3cyclictest0-21swapper/320:52:043
1490299130,2cyclictest39-21ksoftirqd/323:00:113
1490299130,12cyclictest0-21swapper/323:35:143
1490299130,11cyclictest15335-21grep19:10:133
1490299130,11cyclictest0-21swapper/322:41:303
14901991310,2cyclictest0-21swapper/223:41:012
14901991310,2cyclictest0-21swapper/223:37:552
14901991310,2cyclictest0-21swapper/223:27:062
14901991310,2cyclictest0-21swapper/222:45:502
14901991310,2cyclictest0-21swapper/222:37:252
14901991310,2cyclictest0-21swapper/222:29:192
14901991310,2cyclictest0-21swapper/221:21:142
14901991310,2cyclictest0-21swapper/220:10:142
14901991310,2cyclictest0-21swapper/200:30:552
1490199130,2cyclictest29288-21ssh22:15:052
1490199130,2cyclictest0-21swapper/223:45:422
1490199130,2cyclictest0-21swapper/221:47:232
1490199130,2cyclictest0-21swapper/221:17:242
1490199130,2cyclictest0-21swapper/220:30:162
1490199130,2cyclictest0-21swapper/200:35:122
1490199130,2cyclictest0-21swapper/200:12:212
1490199130,2cyclictest0-21swapper/200:04:422
1490199130,12cyclictest0-21swapper/223:15:142
1490199130,12cyclictest0-21swapper/222:23:202
1490199130,12cyclictest0-21swapper/221:37:012
1490199130,12cyclictest0-21swapper/221:31:202
1490199130,12cyclictest0-21swapper/221:25:062
1490199130,12cyclictest0-21swapper/220:55:112
1490199130,11cyclictest0-21swapper/223:30:222
1490099138,3cyclictest20947-21munin-run19:25:011
1490099138,3cyclictest0-21swapper/100:07:581
1490099131,6cyclictest0-21swapper/120:15:011
1490099131,10cyclictest0-21swapper/121:55:121
1490099131,10cyclictest0-21swapper/120:25:131
14900991310,2cyclictest0-21swapper/123:25:401
14900991310,2cyclictest0-21swapper/122:20:111
14900991310,2cyclictest0-21swapper/122:05:151
14900991310,2cyclictest0-21swapper/121:52:091
14900991310,2cyclictest0-21swapper/121:14:581
1490099130,2cyclictest31032-21diskmemload23:47:421
1490099130,2cyclictest0-21swapper/100:10:341
1490099130,12cyclictest0-21swapper/123:15:291
1490099130,12cyclictest0-21swapper/121:25:391
1490099130,12cyclictest0-21swapper/100:20:391
1489999138,3cyclictest0-21swapper/022:29:110
1489999132,7cyclictest0-21swapper/020:10:000
1489999132,6cyclictest0-21swapper/000:15:010
14899991310,2cyclictest31032-21diskmemload21:32:090
14899991310,2cyclictest28244-21kworker/u8:221:10:040
14899991310,2cyclictest15513-21ssh23:07:320
14899991310,2cyclictest0-21swapper/022:51:000
14899991310,2cyclictest0-21swapper/022:30:030
14899991310,2cyclictest0-21swapper/021:59:400
14899991310,2cyclictest0-21swapper/021:15:200
14899991310,2cyclictest0-21swapper/020:35:130
1489999130,2cyclictest917-21ssh23:26:000
1489999130,2cyclictest31032-21diskmemload22:47:490
1489999130,2cyclictest0-21swapper/023:46:020
1489999130,2cyclictest0-21swapper/021:40:400
1489999130,2cyclictest0-21swapper/020:40:110
1489999130,12cyclictest21028-21ssh23:13:400
1489999130,11cyclictest0-21swapper/021:54:540
1489999130,11cyclictest0-21swapper/021:48:000
1489999130,11cyclictest0-21swapper/020:25:390
285942120,2sleep30-21swapper/322:47:063
278862120,2sleep331032-21diskmemload22:13:153
1490299127,3cyclictest0-21swapper/322:20:133
1490299122,7cyclictest0-21swapper/320:32:013
1490299122,7cyclictest0-21swapper/319:28:583
1490299122,6cyclictest0-21swapper/319:51:003
14902991210,1cyclictest0-21swapper/321:45:113
1490299120,3cyclictest4863-21ssh00:37:123
1490299120,11cyclictest0-21swapper/323:28:113
1490299120,11cyclictest0-21swapper/300:26:293
1490299120,10cyclictest0-21swapper/321:20:203
1490199129,2cyclictest0-21swapper/223:20:272
1490199129,2cyclictest0-21swapper/223:00:562
1490199129,2cyclictest0-21swapper/222:12:232
1490199129,2cyclictest0-21swapper/220:45:182
1490199128,2cyclictest27810-21hddtemp_smartct19:40:162
1490199124,5cyclictest301ktimersoftd/219:19:012
1490199121,2cyclictest13097-21apt-get20:25:102
1490199120,2cyclictest0-21swapper/222:58:012
1490199120,2cyclictest0-21swapper/222:58:012
1490199120,2cyclictest0-21swapper/220:16:032
1490199120,2cyclictest0-21swapper/219:10:152
1490199120,11cyclictest0-21swapper/223:55:022
1490199120,11cyclictest0-21swapper/221:40:422
1490199120,11cyclictest0-21swapper/220:35:152
1490199120,11cyclictest0-21swapper/219:46:042
1490199120,11cyclictest0-21swapper/200:06:482
1490099129,2cyclictest0-21swapper/120:56:041
1490099129,2cyclictest0-21swapper/100:36:211
1490099128,2cyclictest0-21swapper/119:30:111
1490099121,9cyclictest0-21swapper/121:00:181
1490099121,9cyclictest0-21swapper/120:45:111
1490099121,3cyclictest17119-21munin-node1
1490099120,6cyclictest0-21swapper/119:30:001
1490099120,3cyclictest0-21swapper/120:01:031
1490099120,11cyclictest0-21swapper/120:30:161
1490099120,11cyclictest0-21swapper/119:55:111
1490099120,11cyclictest0-21swapper/100:26:061
1489999129,2cyclictest21287-21kworker/u8:020:46:050
1489999129,2cyclictest0-21swapper/019:35:300
1489999129,2cyclictest0-21swapper/019:31:000
14899991210,1cyclictest0-21swapper/019:50:140
1489999120,2cyclictest0-21swapper/023:41:070
1489999120,2cyclictest0-21swapper/023:35:190
1489999120,2cyclictest0-21swapper/022:10:190
1489999120,2cyclictest0-21swapper/021:25:520
1489999120,11cyclictest0-21swapper/023:55:120
1489999120,11cyclictest0-21swapper/023:22:300
1489999120,11cyclictest0-21swapper/023:15:500
1489999120,11cyclictest0-21swapper/022:05:390
1489999120,11cyclictest0-21swapper/020:21:000
1489999120,11cyclictest0-21swapper/019:55:150
1489999120,11cyclictest0-21swapper/000:31:090
1489999120,11cyclictest0-21swapper/000:12:200
1489999120,11cyclictest0-21swapper/000:02:090
86112110,2sleep30-21swapper/300:07:393
1490299118,2cyclictest0-21swapper/322:34:103
1490299116,3cyclictest380-21ssh21:10:583
1490299112,6cyclictest0-21swapper/320:58:013
1490299112,6cyclictest0-21swapper/319:31:593
1490299112,5cyclictest0-21swapper/321:30:003
1490299110,3cyclictest0-21swapper/323:52:043
1490299110,2cyclictest0-21swapper/323:45:223
1490299110,2cyclictest0-21swapper/321:36:303
1490299110,10cyclictest0-21swapper/323:07:033
1490299110,10cyclictest0-21swapper/321:44:103
1490199118,2cyclictest0-21swapper/221:00:122
1490099111,8cyclictest5041-21munin-node1
1490099110,3cyclictest0-21swapper/120:50:121
1490099110,3cyclictest0-21swapper/119:50:151
1490099110,10cyclictest0-21swapper/120:22:361
1489999118,2cyclictest0-21swapper/022:15:170
1489999118,2cyclictest0-21swapper/019:25:040
1489999116,3cyclictest28085-21head19:40:180
1489999112,7cyclictest0-21swapper/019:14:590
14232110,2sleep30-21swapper/319:55:153
56362100,1sleep30-21swapper/321:50:133
1490299105,3cyclictest18527-21ssh21:30:123
1490299105,3cyclictest1722-21ssh00:00:173
1490299102,5cyclictest0-21swapper/319:41:023
1490299102,5cyclictest0-21swapper/300:23:013
1490299102,2cyclictest0-21swapper/320:35:043
1490299100,9cyclictest22325-21kworker/u8:022:27:053
1490299100,9cyclictest0-21swapper/322:35:393
1490299100,7cyclictest0-21swapper/323:42:013
1490299100,7cyclictest0-21swapper/320:23:593
1490299100,7cyclictest0-21swapper/300:14:593
1490299100,2cyclictest0-21swapper/322:15:553
1490199107,2cyclictest0-21swapper/220:41:002
1490199102,7cyclictest0-21swapper/219:36:012
1490199102,5cyclictest0-21swapper/219:51:012
1490199100,7cyclictest0-21swapper/221:05:012
1490099100,8cyclictest0-21swapper/120:35:121
1489999105,3cyclictest29470-21tr21:05:130
149029990,8cyclictest20789-21kworker/u8:220:00:043
149019994,3cyclictest23963-21load19:30:152
149019992,6cyclictest0-21swapper/220:22:592
149019991,6cyclictest0-21swapper/220:51:002
149009996,2cyclictest27237-21apt-get19:40:121
148999996,2cyclictest7090-21kworker/u8:121:00:050
148999994,3cyclictest3218-21df_abs20:00:140
148999994,3cyclictest30459-21switchtime19:46:040
148999994,3cyclictest17857-21latency19:15:160
149029983,3cyclictest5083-21taskset20:05:103
149029983,3cyclictest25350-21aten2.4_r3power19:35:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional