You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 06:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat Mar 14, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1013212478,5sleep30-21swapper/319:08:103
32459211994,18sleep00-21swapper/019:05:150
961210695,6sleep20-21swapper/219:07:292
3066621050,1sleep030664-21ssh22:28:580
92329879,14sleep10-21swapper/119:07:001
62242740,0sleep30-21swapper/322:04:033
111882730,0sleep1221ktimersoftd/123:47:311
113942680,0sleep10-21swapper/122:41:171
158232230,0sleep20-21swapper/222:46:042
273942200,1sleep1221ktimersoftd/121:52:041
273942200,1sleep1221ktimersoftd/121:52:031
118999200,2cyclictest0-21swapper/122:50:111
160562190,1sleep3381ktimersoftd/322:14:053
119299182,2cyclictest0-21swapper/320:43:053
119299181,14cyclictest15091-21uptime23:51:023
119299173,12cyclictest0-21swapper/323:58:053
119299172,2cyclictest0-21swapper/323:28:053
119299172,13cyclictest0-21swapper/323:12:053
1192991714,2cyclictest17781-21kworker/u8:219:55:053
119299170,5cyclictest0-21swapper/322:26:053
119299170,4cyclictest0-21swapper/300:22:043
119299170,15cyclictest0-21swapper/323:18:523
119199171,14cyclictest17581-21latency_hist19:50:002
118999170,16cyclictest0-21swapper/119:42:051
118999170,13cyclictest0-21swapper/100:12:041
118999170,12cyclictest0-21swapper/100:02:051
150842160,0sleep00-21swapper/023:19:050
119299162,2cyclictest0-21swapper/322:40:053
119299161,3cyclictest0-21swapper/300:35:073
1192991613,2cyclictest29835-21kworker/u8:120:30:053
119299161,2cyclictest0-21swapper/321:50:043
119299161,2cyclictest0-21swapper/321:50:043
119299161,13cyclictest1871-21fschecks_time23:05:143
119299160,14cyclictest0-21swapper/321:23:053
118999160,3cyclictest17793-21latency_hist23:55:011
118999160,15cyclictest0-21swapper/123:04:061
118999160,14cyclictest0-21swapper/121:05:091
118999160,12cyclictest0-21swapper/100:26:051
118999160,11cyclictest0-21swapper/122:59:041
118999160,11cyclictest0-21swapper/100:31:041
118699160,14cyclictest16233-21hddtemp_smartct21:05:110
119299153,2cyclictest0-21swapper/323:02:043
119299152,2cyclictest26627-21ssh21:19:043
119299152,2cyclictest0-21swapper/321:26:043
119299152,2cyclictest0-21swapper/320:38:043
119299151,2cyclictest0-21swapper/300:04:053
1192991512,2cyclictest8664-21kworker/u8:122:07:053
1192991512,2cyclictest6368-21kworker/u8:123:47:053
1192991512,2cyclictest25925-21kworker/u8:220:18:053
1192991512,2cyclictest15352-21kworker/u8:019:47:043
1192991511,2cyclictest0-21swapper/319:16:003
119299150,13cyclictest0-21swapper/300:12:533
119199151,3cyclictest0-21swapper/219:35:132
119199151,12cyclictest0-21swapper/221:38:062
118999159,4cyclictest0-21swapper/100:09:411
118999151,12cyclictest27903-21aten2.4_r3power20:15:111
118999150,2cyclictest0-21swapper/100:18:021
118999150,11cyclictest0-21swapper/122:48:051
118999150,11cyclictest0-21swapper/120:02:041
118699150,13cyclictest20292-21ssh00:30:130
292822140,2sleep00-21swapper/021:54:560
292822140,2sleep00-21swapper/021:54:550
274662140,2sleep00-21swapper/022:58:240
119299149,3cyclictest7558-21sh00:16:323
119299142,2cyclictest0-21swapper/323:35:053
119299142,2cyclictest0-21swapper/321:47:053
119299141,7cyclictest0-21swapper/320:12:043
119299141,2cyclictest0-21swapper/319:44:053
1192991411,2cyclictest9211-21kworker/u8:221:04:043
119299140,2cyclictest0-21swapper/323:31:353
119299140,2cyclictest0-21swapper/322:32:053
119299140,2cyclictest0-21swapper/300:05:223
119299140,13cyclictest0-21swapper/319:27:053
119299140,12cyclictest0-21swapper/323:40:423
119299140,12cyclictest0-21swapper/322:46:523
119299140,12cyclictest0-21swapper/321:55:413
119299140,12cyclictest0-21swapper/321:10:523
1191991411,2cyclictest17457-21diskmemload22:52:342
1191991411,2cyclictest0-21swapper/222:05:282
1191991411,2cyclictest0-21swapper/221:21:242
1191991411,2cyclictest0-21swapper/220:20:102
1191991411,2cyclictest0-21swapper/220:00:092
1191991411,2cyclictest0-21swapper/219:20:152
119199141,11cyclictest6511-21ssh21:30:452
119199140,2cyclictest0-21swapper/222:26:262
119199140,13cyclictest0-21swapper/223:52:292
119199140,13cyclictest0-21swapper/222:23:082
119199140,12cyclictest0-21swapper/223:30:122
1189991411,2cyclictest8664-21kworker/u8:122:06:051
1189991411,2cyclictest17457-21diskmemload21:38:281
1189991411,2cyclictest0-21swapper/123:18:211
1189991411,2cyclictest0-21swapper/122:32:271
1189991411,2cyclictest0-21swapper/100:21:481
118999140,9cyclictest0-21swapper/122:20:051
118999140,2cyclictest0-21swapper/123:05:381
118999140,2cyclictest0-21swapper/121:42:041
118999140,2cyclictest0-21swapper/121:15:271
118999140,13cyclictest0-21swapper/123:14:061
118999140,12cyclictest4928-21grep21:30:011
118999140,12cyclictest24622-21ntpdc20:05:171
118999140,12cyclictest17255-21ssh23:20:301
118999140,12cyclictest0-21swapper/119:35:181
118999140,10cyclictest0-21swapper/122:38:051
118999140,10cyclictest0-21swapper/122:11:051
1186991411,2cyclictest19801-21kworker/u8:222:19:040
118699140,13cyclictest17457-21diskmemload22:23:080
118699140,12cyclictest7402-21munin-run20:44:590
314602130,2sleep00-21swapper/023:35:170
257142130,2sleep30-21swapper/322:23:533
1192991310,2cyclictest13473-21kworker/u8:122:53:043
1192991310,2cyclictest0-21swapper/323:20:473
1192991310,2cyclictest0-21swapper/322:59:133
1192991310,2cyclictest0-21swapper/300:30:003
119299130,2cyclictest0-21swapper/319:51:033
119299130,12cyclictest5420-21ssh22:35:193
119299130,12cyclictest0-21swapper/321:40:323
119199131,10cyclictest0-21swapper/223:45:132
1191991310,2cyclictest1176-21ssh21:59:052
1191991310,2cyclictest0-21swapper/223:55:492
1191991310,2cyclictest0-21swapper/223:16:072
1191991310,2cyclictest0-21swapper/223:00:362
1191991310,2cyclictest0-21swapper/222:56:452
1191991310,2cyclictest0-21swapper/222:30:182
1191991310,2cyclictest0-21swapper/222:00:072
1191991310,2cyclictest0-21swapper/221:51:482
1191991310,2cyclictest0-21swapper/221:51:472
1191991310,2cyclictest0-21swapper/221:25:252
1191991310,2cyclictest0-21swapper/200:26:572
1191991310,2cyclictest0-21swapper/200:15:282
1191991310,2cyclictest0-21swapper/200:07:132
119199130,2cyclictest0-21swapper/223:37:082
119199130,2cyclictest0-21swapper/223:05:382
119199130,2cyclictest0-21swapper/222:11:062
119199130,2cyclictest0-21swapper/221:40:372
119199130,2cyclictest0-21swapper/221:11:252
119199130,12cyclictest8381-21ssh23:11:082
119199130,12cyclictest0-21swapper/223:40:042
119199130,12cyclictest0-21swapper/223:27:592
119199130,12cyclictest0-21swapper/223:23:582
119199130,12cyclictest0-21swapper/222:40:232
119199130,12cyclictest0-21swapper/222:37:442
119199130,12cyclictest0-21swapper/222:15:162
119199130,12cyclictest0-21swapper/221:47:552
119199130,12cyclictest0-21swapper/221:17:132
119199130,12cyclictest0-21swapper/220:30:122
119199130,12cyclictest0-21swapper/200:35:342
119199130,12cyclictest0-21swapper/200:20:542
119199130,12cyclictest0-21swapper/200:11:302
119199130,12cyclictest0-21swapper/200:00:082
118999131,5cyclictest0-21swapper/119:33:591
1189991310,2cyclictest24579-21copy00:35:021
1189991310,2cyclictest0-21swapper/123:41:501
1189991310,2cyclictest0-21swapper/123:32:401
1189991310,2cyclictest0-21swapper/120:55:011
118999130,9cyclictest0-21swapper/122:18:041
118999130,2cyclictest2186-21aten2.4_r3power22:00:111
118999130,12cyclictest0-21swapper/119:50:141
118999130,11cyclictest17457-21diskmemload23:37:121
118999130,11cyclictest0-21swapper/120:50:281
118999130,11cyclictest0-21swapper/119:20:271
1186991310,2cyclictest25934-21kworker/u8:023:14:020
1186991310,2cyclictest17457-21diskmemload21:16:160
1186991310,2cyclictest0-21swapper/022:50:110
118699130,2cyclictest0-21swapper/023:05:380
118699130,12cyclictest0-21swapper/023:52:290
118699130,12cyclictest0-21swapper/021:10:110
118699130,11cyclictest0-21swapper/021:25:160
75932120,2sleep00-21swapper/023:44:310
164072120,2sleep30-21swapper/300:25:463
119299129,2cyclictest0-21swapper/322:16:123
119299129,2cyclictest0-21swapper/320:25:053
119299127,3cyclictest0-21swapper/320:56:043
119299120,2cyclictest0-21swapper/319:35:173
119299120,11cyclictest0-21swapper/321:35:033
119299120,11cyclictest0-21swapper/321:31:093
119299120,11cyclictest0-21swapper/319:10:183
119199129,2cyclictest0-21swapper/220:25:102
119199129,2cyclictest0-21swapper/219:30:172
119199129,2cyclictest0-21swapper/219:16:002
119199129,2cyclictest0-21swapper/219:10:062
119199120,2cyclictest0-21swapper/220:40:392
119199120,2cyclictest0-21swapper/219:51:042
119199120,11cyclictest0-21swapper/220:10:142
119199120,11cyclictest0-21swapper/200:31:052
118999129,2cyclictest0-21swapper/123:55:091
118999129,2cyclictest0-21swapper/123:25:021
118999129,2cyclictest0-21swapper/121:23:281
118999120,6cyclictest0-21swapper/120:32:051
118999120,2cyclictest0-21swapper/120:21:031
118999120,11cyclictest0-21swapper/122:25:411
118999120,11cyclictest0-21swapper/121:57:201
118999120,11cyclictest0-21swapper/121:46:081
118999120,11cyclictest0-21swapper/121:30:041
118999120,11cyclictest0-21swapper/121:10:291
118999120,11cyclictest0-21swapper/120:25:491
118699120,3cyclictest29241-21ssh23:33:120
118699120,3cyclictest12375-21latency19:35:160
118699120,2cyclictest0-21swapper/021:48:170
118699120,1cyclictest0-21swapper/022:05:150
118699120,1cyclictest0-21swapper/021:30:150
118699120,11cyclictest6368-21kworker/u8:123:46:040
118699120,11cyclictest0-21swapper/020:20:100
118699120,11cyclictest0-21swapper/019:15:160
118699120,11cyclictest0-21swapper/000:22:230
118699120,10cyclictest0-21swapper/000:17:230
62852110,2sleep00-21swapper/022:04:100
119299118,2cyclictest0-21swapper/320:06:203
119299113,6cyclictest0-21swapper/320:48:023
119299110,8cyclictest4562-21gdm-simple-gree21:08:593
119299110,10cyclictest0-21swapper/320:00:083
119199111,3cyclictest87892awk20:46:012
118999118,2cyclictest0-21swapper/121:00:161
118999112,6cyclictest0-21swapper/119:26:011
118999110,9cyclictest0-21swapper/120:35:121
118999110,2cyclictest0-21swapper/120:40:151
118699118,2cyclictest16547-21fschecks_time23:20:120
118699118,2cyclictest0-21swapper/023:02:410
118699118,2cyclictest0-21swapper/022:45:100
118699118,2cyclictest0-21swapper/021:55:100
118699118,2cyclictest0-21swapper/000:35:120
118699116,3cyclictest15611-21latency_hist21:05:010
118699110,9cyclictest0-21swapper/023:57:480
118699110,9cyclictest0-21swapper/019:50:160
118699110,2cyclictest0-21swapper/022:37:170
118699110,10cyclictest0-21swapper/022:40:170
118699110,10cyclictest0-21swapper/021:37:480
118699110,10cyclictest0-21swapper/000:00:090
26042100,2sleep00-21swapper/022:33:070
207372100,2sleep10-21swapper/119:55:321
119299100,9cyclictest0-21swapper/319:24:193
119199107,2cyclictest0-21swapper/219:40:182
118999107,2cyclictest18235-21kworker/u8:119:10:041
118999107,2cyclictest0-21swapper/120:10:131
118999101,6cyclictest4562-21gdm-simple-gree19:48:591
118999100,8cyclictest0-21swapper/120:45:151
118999100,7cyclictest0-21swapper/119:17:591
118699107,2cyclictest25925-21kworker/u8:220:16:040
118699107,2cyclictest0-21swapper/023:29:030
118699107,2cyclictest0-21swapper/021:41:460
118699100,9cyclictest17457-21diskmemload21:21:370
118699100,9cyclictest0-21swapper/022:10:300
11929994,3cyclictest9658-21apt19:30:103
11929994,3cyclictest29816-21aten2.4_r3power20:20:113
11919996,2cyclictest0-21swapper/221:00:142
11919991,3cyclictest0-21swapper/219:25:132
11919990,8cyclictest0-21swapper/220:35:162
11869996,2cyclictest17781-21kworker/u8:219:58:020
11869996,2cyclictest0-21swapper/019:30:150
11869992,3cyclictest28905-1kworker/u9:100:09:190
11869991,6cyclictest1394-21munin-node0
11869990,2cyclictest0-21swapper/000:29:530
11869990,1cyclictest0-21swapper/019:45:160
11929983,3cyclictest9719-21stty20:50:113
11919985,2cyclictest0-21swapper/220:50:122
11919985,2cyclictest0-21swapper/219:55:042
11919983,3cyclictest11698-21aten2.4_r3power20:55:122
11919981,3cyclictest16555-21ntp_states21:05:142
11919981,3cyclictest0-21swapper/220:05:222
11919980,7cyclictest28006-21tr20:15:122
11869985,2cyclictest0-21swapper/020:49:320
11869985,2cyclictest0-21swapper/020:25:270
11869985,2cyclictest0-21swapper/019:40:150
11869984,3cyclictest26575-21cat20:10:170
11869983,3cyclictest32613-21rm00:10:050
11869983,3cyclictest25540-21cron20:09:590
11869980,2cyclictest0-21swapper/019:29:190
11869973,3cyclictest6172-21uniq19:20:120
11869973,3cyclictest10386-21cat20:50:170
11869973,2cyclictest3549-21aten2.4_r3power20:35:110
11869972,3cyclictest21806-21tail20:00:100
11869970,6cyclictest11745-21basename20:55:110
11869970,3cyclictest0-21swapper/019:10:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional