You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 01:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Apr 15, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4082212097,18sleep30-21swapper/319:08:353
4091211897,16sleep20-21swapper/219:08:422
4153211790,21sleep00-21swapper/019:09:280
3932211596,14sleep10-21swapper/119:06:401
35852850,27sleep1207150irq/24-eth100:13:531
14602700,1sleep20-21swapper/220:21:002
288492690,0sleep30-21swapper/320:10:123
6232640,2sleep09-21ksoftirqd/023:02:540
48522320,1sleep14855-21df_abs19:10:121
429099211,18cyclictest0-21swapper/322:15:123
221552210,0sleep10-21swapper/122:18:141
4290991712,3cyclictest32339-1kworker/u9:023:15:143
159032170,0sleep30-21swapper/323:52:303
4289991613,2cyclictest16207-21kworker/u8:123:20:052
428999161,13cyclictest8932-21wget23:45:162
428999161,13cyclictest31587-21awk23:01:022
428999161,13cyclictest0-21swapper/222:46:272
428899161,13cyclictest0-21swapper/120:56:031
428899160,14cyclictest0-21swapper/121:16:021
428899160,14cyclictest0-21swapper/120:11:011
429099152,8cyclictest10330-21ssh22:39:593
429099151,12cyclictest0-21swapper/321:35:143
4290991510,3cyclictest2579-21cpuspeed_turbos23:05:133
429099150,3cyclictest26068-21grep22:55:183
429099150,13cyclictest16207-21kworker/u8:123:25:033
4289991512,2cyclictest7303-21kworker/u8:022:44:042
4289991512,2cyclictest26523-21ssh23:30:112
4289991512,2cyclictest0-21swapper/221:40:112
428999151,12cyclictest30075-21ssh21:52:442
428999151,12cyclictest13713-21sh00:24:262
428999150,3cyclictest15119-21tune2fs20:55:142
428999150,2cyclictest0-21swapper/200:03:042
428999150,13cyclictest14548-21mailstats23:50:592
4288991510,3cyclictest19344-21irqstats21:05:181
428899150,2cyclictest0-21swapper/122:55:181
429099142,7cyclictest0-21swapper/323:45:003
429099142,6cyclictest0-21swapper/323:50:003
4290991410,2cyclictest0-21swapper/320:40:153
429099140,12cyclictest0-21swapper/323:20:153
428999141,2cyclictest5277-21ssh23:07:222
428999141,2cyclictest0-21swapper/222:56:292
4289991411,2cyclictest29029-21kworker/u8:222:03:032
4289991411,2cyclictest14631-21kworker/u8:021:00:042
4289991411,2cyclictest0-21swapper/222:15:312
428999140,3cyclictest21671-21ssh23:25:062
428999140,2cyclictest0-21swapper/221:11:002
428999140,12cyclictest14887-21fschecks_count00:25:152
428999140,12cyclictest0-21swapper/222:35:092
4288991411,2cyclictest0-21swapper/121:42:321
4288991411,2cyclictest0-21swapper/100:27:231
4288991410,2cyclictest10364-21apt-get19:25:071
4288991410,2cyclictest10364-21apt-get19:25:061
428899140,3cyclictest8767-21ssh22:37:361
428899140,2cyclictest22973-21ssh00:33:521
428899140,13cyclictest0-21swapper/122:25:011
428899140,12cyclictest26413-21rm00:36:441
428899140,12cyclictest0-21swapper/123:59:381
428899140,12cyclictest0-21swapper/120:45:201
428899140,12cyclictest0-21swapper/100:23:171
4287991411,2cyclictest0-21swapper/021:45:110
4287991411,2cyclictest0-21swapper/000:35:120
4287991410,2cyclictest0-21swapper/022:44:420
428799140,2cyclictest0-21swapper/000:19:120
428799140,12cyclictest20453-21diskmemload22:05:170
428799140,12cyclictest10037-21users19:21:040
428799140,12cyclictest10037-21users19:21:040
164282140,2sleep20-21swapper/223:19:472
429099138,3cyclictest13626-21ssh22:09:573
429099133,7cyclictest4562-21gdm-simple-gree22:28:593
429099133,7cyclictest28077-21ssh22:24:593
429099132,6cyclictest0-21swapper/322:50:013
429099132,6cyclictest0-21swapper/319:15:003
429099132,6cyclictest0-21swapper/300:40:003
429099131,3cyclictest0-21swapper/321:41:023
429099131,10cyclictest21905-21ssh21:10:233
429099130,2cyclictest0-21swapper/321:30:143
429099130,12cyclictest0-21swapper/300:23:393
4289991310,2cyclictest25678-21ssh22:21:112
4289991310,2cyclictest2229-21ssh22:30:512
4289991310,2cyclictest19725-21kworker/u8:120:06:042
4289991310,2cyclictest12619-21kworker/u8:019:37:042
4289991310,2cyclictest0-21swapper/223:35:422
4289991310,2cyclictest0-21swapper/222:51:142
4289991310,2cyclictest0-21swapper/221:46:022
4289991310,2cyclictest0-21swapper/221:35:172
4289991310,2cyclictest0-21swapper/221:20:562
4289991310,2cyclictest0-21swapper/219:40:182
4289991310,2cyclictest0-21swapper/200:36:302
4289991310,2cyclictest0-21swapper/200:12:042
428999130,2cyclictest0-21swapper/222:10:082
428999130,2cyclictest0-21swapper/222:05:332
428999130,2cyclictest0-21swapper/221:59:342
428999130,2cyclictest0-21swapper/221:30:442
428999130,2cyclictest0-21swapper/221:26:232
428999130,2cyclictest0-21swapper/200:07:082
428999130,12cyclictest6657-21ssh23:42:562
428999130,12cyclictest0-21swapper/223:55:142
428999130,12cyclictest0-21swapper/223:12:112
428999130,12cyclictest0-21swapper/222:26:502
428999130,12cyclictest0-21swapper/221:15:292
428999130,12cyclictest0-21swapper/200:31:502
428899139,2cyclictest0-21swapper/100:02:031
428899131,11cyclictest4286-21cyclictest21:33:481
4288991310,2cyclictest0-21swapper/123:46:041
4288991310,2cyclictest0-21swapper/121:46:301
4288991310,2cyclictest0-21swapper/120:05:121
428899130,2cyclictest27036-21apt-get21:50:111
428899130,2cyclictest0-21swapper/122:22:421
428899130,2cyclictest0-21swapper/121:57:021
428899130,12cyclictest0-21swapper/123:51:031
428899130,12cyclictest0-21swapper/123:33:131
428899130,12cyclictest0-21swapper/123:15:121
428899130,12cyclictest0-21swapper/123:08:481
428899130,12cyclictest0-21swapper/122:51:121
428899130,12cyclictest0-21swapper/122:06:421
428899130,12cyclictest0-21swapper/120:00:151
4287991310,2cyclictest24583-21kworker/u8:200:03:040
4287991310,2cyclictest0-21swapper/023:17:250
4287991310,2cyclictest0-21swapper/022:46:200
4287991310,2cyclictest0-21swapper/022:35:010
4287991310,2cyclictest0-21swapper/022:20:170
4287991310,2cyclictest0-21swapper/022:15:110
4287991310,2cyclictest0-21swapper/021:30:190
4287991310,2cyclictest0-21swapper/021:26:060
428799130,2cyclictest0-21swapper/023:35:360
428799130,2cyclictest0-21swapper/022:55:130
428799130,12cyclictest0-21swapper/023:06:310
428799130,12cyclictest0-21swapper/000:30:020
428799130,11cyclictest17092-21ssh22:12:500
185252130,2sleep30-21swapper/300:29:283
44262120,1sleep30-21swapper/322:00:123
429099129,2cyclictest0-21swapper/300:10:593
429099128,2cyclictest0-21swapper/300:02:203
429099121,3cyclictest0-21swapper/323:37:143
429099120,2cyclictest0-21swapper/323:59:413
429099120,2cyclictest0-21swapper/320:00:133
429099120,11cyclictest0-21swapper/323:31:393
428999129,2cyclictest4152-21kworker/u8:220:50:042
428999129,2cyclictest24583-21kworker/u8:200:15:042
428999129,2cyclictest0-21swapper/219:56:012
428999120,2cyclictest0-21swapper/219:10:172
428999120,11cyclictest0-21swapper/220:35:102
428999120,11cyclictest0-21swapper/219:50:102
428899129,2cyclictest0-21swapper/123:40:121
428899129,2cyclictest0-21swapper/123:21:461
428899129,2cyclictest0-21swapper/122:00:151
428899129,2cyclictest0-21swapper/121:36:061
428899129,2cyclictest0-21swapper/120:31:001
428899129,2cyclictest0-21swapper/119:40:121
428899127,3cyclictest11549-21sed22:40:181
428899121,3cyclictest24508-21sendmail20:00:001
428899120,2cyclictest0-21swapper/123:25:531
428899120,2cyclictest0-21swapper/122:30:401
428899120,2cyclictest0-21swapper/119:45:131
428899120,11cyclictest0-21swapper/123:37:481
428899120,11cyclictest0-21swapper/123:00:181
428899120,11cyclictest0-21swapper/122:46:531
428899120,11cyclictest0-21swapper/122:14:001
428899120,11cyclictest0-21swapper/121:25:321
428899120,11cyclictest0-21swapper/121:10:191
428899120,11cyclictest0-21swapper/100:17:431
428899120,11cyclictest0-21swapper/100:06:241
428899120,10cyclictest0-21swapper/121:20:191
428799129,2cyclictest0-21swapper/023:50:490
428799129,2cyclictest0-21swapper/023:43:270
428799129,2cyclictest0-21swapper/022:29:410
428799129,2cyclictest0-21swapper/021:55:540
428799129,2cyclictest0-21swapper/021:52:240
428799129,2cyclictest0-21swapper/020:50:180
428799129,2cyclictest0-21swapper/000:22:540
428799120,2cyclictest0-21swapper/023:47:430
428799120,2cyclictest0-21swapper/023:34:050
428799120,2cyclictest0-21swapper/021:40:390
428799120,2cyclictest0-21swapper/021:35:490
428799120,2cyclictest0-21swapper/000:25:170
428799120,2cyclictest0-21swapper/000:10:520
428799120,2cyclictest0-21swapper/000:08:030
428799120,11cyclictest1920-21ssh22:30:250
428799120,11cyclictest0-21swapper/023:55:040
428799120,11cyclictest0-21swapper/022:50:190
428799120,11cyclictest0-21swapper/021:23:150
428799120,11cyclictest0-21swapper/021:15:130
428799120,11cyclictest0-21swapper/021:05:200
428799120,11cyclictest0-21swapper/019:50:160
428799120,11cyclictest0-21swapper/019:30:140
428799120,10cyclictest0-21swapper/023:12:020
209582120,1sleep00-21swapper/023:24:190
207302120,2sleep30-21swapper/300:31:003
166182120,2sleep30-21swapper/321:00:053
84952110,2sleep120453-21diskmemload23:10:331
429099118,2cyclictest0-21swapper/300:05:293
429099117,2cyclictest30438-21sh21:20:113
429099117,2cyclictest0-21swapper/319:55:123
429099114,4cyclictest0-21swapper/320:45:033
429099113,2cyclictest0-21swapper/323:10:043
429099112,7cyclictest0-21swapper/322:33:023
429099112,6cyclictest23848-21ssh21:46:013
429099111,6cyclictest0-21swapper/320:56:013
429099110,9cyclictest32038-21munin-node3
429099110,10cyclictest0-21swapper/322:10:263
428999118,2cyclictest4152-21kworker/u8:220:44:042
428999118,2cyclictest28794-21kworker/u8:020:29:042
428999118,2cyclictest22752-21kworker/u8:220:19:042
428999110,10cyclictest0-21swapper/220:45:122
428999110,10cyclictest0-21swapper/219:34:092
428899118,2cyclictest0-21swapper/121:00:041
428899118,2cyclictest0-21swapper/119:15:511
428899112,5cyclictest0-21swapper/119:40:011
428899111,8cyclictest2353-21munin-node1
428899111,2cyclictest12590-21apt-get20:50:121
428899110,9cyclictest0-21swapper/120:20:171
428899110,9cyclictest0-21swapper/119:21:031
428899110,9cyclictest0-21swapper/119:21:031
428899110,10cyclictest0-21swapper/120:36:011
428799118,2cyclictest0-21swapper/022:01:390
428799118,2cyclictest0-21swapper/019:10:140
428799110,2cyclictest0-21swapper/023:27:510
428799110,10cyclictest0-21swapper/021:10:220
300612110,2sleep30-21swapper/321:52:433
257552110,2sleep00-21swapper/020:00:280
187072110,2sleep30-21swapper/319:45:133
176402110,2sleep30-21swapper/319:40:203
429099107,2cyclictest0-21swapper/300:16:303
429099105,3cyclictest22337-21sshd22:51:123
429099105,3cyclictest10974-21ssh22:40:143
429099103,6cyclictest0-21swapper/323:00:003
429099103,5cyclictest3151-21nscd21:19:363
429099102,7cyclictest0-21swapper/320:37:593
429099102,5cyclictest0-21swapper/319:16:583
429099100,8cyclictest5762-21ssh21:27:223
429099100,7cyclictest0-21swapper/321:57:593
428999108,1cyclictest0-21swapper/220:00:152
428999107,2cyclictest22752-21kworker/u8:220:12:042
428999107,2cyclictest0-21swapper/221:09:112
428999107,2cyclictest0-21swapper/219:25:192
428999107,2cyclictest0-21swapper/219:25:192
428999100,2cyclictest0-21swapper/219:20:412
428999100,2cyclictest0-21swapper/219:20:412
428999100,2cyclictest0-21swapper/219:16:042
428899100,8cyclictest0-21swapper/120:40:131
428899100,8cyclictest0-21swapper/120:15:191
428899100,8cyclictest0-21swapper/119:50:111
428899100,2cyclictest0-21swapper/119:30:151
428799107,2cyclictest0-21swapper/020:20:150
428799100,9cyclictest0-21swapper/020:40:120
42909994,3cyclictest21657-21processes19:50:173
42909994,3cyclictest19076-21fschecks_count21:05:163
42909994,3cyclictest12662-21aten2.4_r3power19:30:113
42909994,3cyclictest11671-21seq19:25:503
42909994,3cyclictest11671-21seq19:25:503
42909994,3cyclictest1050-21grep20:20:153
42909994,3cyclictest0-21swapper/320:30:013
42909994,3cyclictest0-21swapper/320:05:133
42909992,5cyclictest0-21swapper/319:20:593
42909992,5cyclictest0-21swapper/319:20:593
42909991,5cyclictest0-21swapper/320:30:363
42899994,3cyclictest5657-21cut20:30:592
42899994,3cyclictest186872sleep219:45:032
42879996,2cyclictest0-21swapper/019:27:460
42879996,2cyclictest0-21swapper/019:27:460
42879996,2cyclictest0-21swapper/019:15:180
42909983,3cyclictest3153-21nscd19:35:083
42909983,3cyclictest12587-21munin-node3
42879985,2cyclictest0-21swapper/020:55:150
42879984,3cyclictest14637-21packagekitd19:36:350
42879983,3cyclictest3264-21ntp_kernel_pll_20:25:180
42879983,3cyclictest3127-21nscd20:30:120
42879983,3cyclictest18037-21grep21:01:020
42879982,5cyclictest0-21swapper/020:49:040
42879981,3cyclictest27145-21diskstats20:05:130
42879980,7cyclictest0-21swapper/020:35:030
42879980,7cyclictest0-21swapper/020:15:510
42879980,2cyclictest0-21swapper/019:57:170
42879980,2cyclictest0-21swapper/019:49:580
42879974,2cyclictest101ktimersoftd/019:40:120
42879970,6cyclictest0-21swapper/020:10:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional