You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 14:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Fri Sep 11, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2054021160,5sleep320542-21sed06:11:183
64342950,9sleep13203199cyclictest05:41:211
309552720,6sleep230954-21awk09:16:082
32030996631,20cyclictest0-21swapper/010:41:080
32030996332,19cyclictest0-21swapper/009:05:500
32030996332,19cyclictest0-21swapper/009:05:500
32030996332,13cyclictest0-21swapper/010:21:030
32032996225,30cyclictest16481-21munin-node08:55:562
3203099624,50cyclictest0-21swapper/009:41:420
3203099623,53cyclictest0-21swapper/010:40:160
86832617,11sleep10-21swapper/107:54:201
32030996140,10cyclictest0-21swapper/009:26:410
172282613,12sleep20-21swapper/209:45:522
172282613,12sleep20-21swapper/209:45:522
32030996033,13cyclictest0-21swapper/007:46:040
32030996033,13cyclictest0-21swapper/007:46:040
3203099603,51cyclictest0-21swapper/010:01:130
93842593,49sleep30-21swapper/308:44:463
3203399595,37cyclictest28279-21ntp_states10:01:063
3203299592,51cyclictest0-21swapper/209:09:412
3203299592,51cyclictest0-21swapper/209:09:412
32030995932,10cyclictest10525-21munin-node09:36:120
3203099593,14cyclictest0-21swapper/007:56:120
3203299584,36cyclictest0-21swapper/207:51:092
32030995832,12cyclictest0-21swapper/010:27:280
32030995832,12cyclictest0-21swapper/010:27:280
32030995831,13cyclictest0-21swapper/010:31:150
3203099583,49cyclictest0-21swapper/009:01:040
32030995822,12cyclictest0-21swapper/009:15:410
249942583,12sleep20-21swapper/209:56:082
3203099573,48cyclictest0-21swapper/006:36:020
219172574,47sleep20-21swapper/209:02:222
210162573,47sleep00-21swapper/006:13:220
3203299565,13cyclictest0-21swapper/208:13:282
3203299564,24cyclictest0-21swapper/210:35:122
32031995631,12cyclictest0-21swapper/110:30:381
32031995631,12cyclictest0-21swapper/110:30:381
3203199562,48cyclictest14785-21ssh08:51:141
32030995634,10cyclictest0-21swapper/009:51:040
32030995632,12cyclictest0-21swapper/008:49:550
32030995631,12cyclictest0-21swapper/010:55:480
32030995631,12cyclictest0-21swapper/010:06:110
32030995631,12cyclictest0-21swapper/007:10:560
32030995631,12cyclictest0-21swapper/007:10:560
3203099563,47cyclictest0-21swapper/008:15:560
3203099563,47cyclictest0-21swapper/007:54:430
3203099563,12cyclictest0-21swapper/010:12:390
32030995629,13cyclictest0-21swapper/007:31:120
3203099562,48cyclictest0-21swapper/006:31:030
219499560,6rtkit-daemon2193-21rtkit-daemon10:13:123
219499560,5rtkit-daemon2193-21rtkit-daemon09:51:053
3203399554,44cyclictest0-21swapper/309:13:243
3203299554,45cyclictest0-21swapper/210:19:172
32032995538,9cyclictest8054-21wc05:46:102
32032995514,25cyclictest0-21swapper/207:41:292
32031995529,12cyclictest0-21swapper/108:16:151
32031995528,13cyclictest0-21swapper/110:05:501
3203099554,46cyclictest0-21swapper/007:36:120
32030995530,12cyclictest0-21swapper/005:41:120
3203099553,47cyclictest0-21swapper/010:00:390
32030995529,12cyclictest0-21swapper/010:15:570
303982553,45sleep00-21swapper/010:55:080
238762553,8sleep223880-21ssh10:45:192
86752543,44sleep00-21swapper/008:42:000
32033995439,9cyclictest27431-21needreboot06:26:133
32033995439,9cyclictest27431-21needreboot06:26:133
3203299545,40cyclictest0-21swapper/208:25:532
3203299545,40cyclictest0-21swapper/208:25:532
3203299544,43cyclictest0-21swapper/208:40:542
32032995411,27cyclictest0-21swapper/209:51:002
32031995432,11cyclictest0-21swapper/108:59:521
32031995429,13cyclictest0-21swapper/107:59:121
32031995427,13cyclictest0-21swapper/110:21:011
3203199542,46cyclictest1630-21sort09:21:051
3203099544,45cyclictest0-21swapper/007:41:000
3203099543,46cyclictest0-21swapper/010:45:580
3203099543,46cyclictest0-21swapper/008:06:150
3203099543,44cyclictest0-21swapper/008:35:590
32030995426,12cyclictest0-21swapper/008:55:360
32030995422,15cyclictest0-21swapper/009:50:400
32030995422,15cyclictest0-21swapper/009:50:400
3203099542,46cyclictest0-21swapper/009:21:270
32030995414,24cyclictest1227-21runrttasks09:18:140
219499540,5rtkit-daemon2193-21rtkit-daemon10:36:043
219499540,5rtkit-daemon2193-21rtkit-daemon07:56:173
219499540,4rtkit-daemon2193-21rtkit-daemon07:38:553
186172542,10sleep30-21swapper/308:57:193
47462532,9sleep20-21swapper/207:47:122
47462532,9sleep20-21swapper/207:47:122
39422532,9sleep20-21swapper/210:14:312
32032995338,9cyclictest20544-21cpuspeed_turbos07:21:002
32031995340,8cyclictest20732-21idleruntime09:01:021
3203199533,44cyclictest0-21swapper/108:31:101
32031995328,12cyclictest0-21swapper/110:00:511
3203199532,46cyclictest0-21swapper/110:16:491
3203199532,45cyclictest0-21swapper/109:30:521
3203199532,44cyclictest18185-21ssh09:46:031
3203199532,44cyclictest18185-21ssh09:46:031
32030995330,10cyclictest0-21swapper/006:45:590
3203099533,46cyclictest0-21swapper/006:26:380
3203099533,46cyclictest0-21swapper/006:26:380
3203099533,45cyclictest0-21swapper/008:25:580
3203099533,45cyclictest0-21swapper/008:25:580
3203099533,45cyclictest0-21swapper/008:11:040
32030995325,13cyclictest0-21swapper/008:56:020
3203099532,45cyclictest0-21swapper/009:31:000
32030995317,8cyclictest14880-21taskset08:02:520
32030995317,30cyclictest909-21crond07:20:450
271772532,9sleep20-21swapper/210:50:232
219499530,6rtkit-daemon2193-21rtkit-daemon08:16:163
219499530,5rtkit-daemon2193-21rtkit-daemon10:26:113
219499530,5rtkit-daemon2193-21rtkit-daemon10:26:113
219499530,5rtkit-daemon2193-21rtkit-daemon08:50:303
219499530,5rtkit-daemon2193-21rtkit-daemon05:56:222
167872532,9sleep10-21swapper/110:33:161
137542533,44sleep313786-21diskstats08:50:583
32033995237,9cyclictest5798-21unixbench_singl09:26:133
32033995235,10cyclictest15636-21unixbench_singl09:41:143
3203299528,14cyclictest0-21swapper/208:00:252
3203299527,29cyclictest0-21swapper/208:01:012
3203299526,39cyclictest0-21swapper/206:06:042
3203299524,31cyclictest0-21swapper/205:51:022
3203299523,42cyclictest0-21swapper/207:35:582
32032995210,26cyclictest0-21swapper/209:10:562
3203199523,44cyclictest0-21swapper/110:45:591
3203199523,44cyclictest0-21swapper/110:35:591
3203199523,44cyclictest0-21swapper/107:31:011
3203199523,43cyclictest3610-21yum-updatesd-he10:13:301
32031995227,12cyclictest0-21swapper/110:40:511
32031995226,12cyclictest0-21swapper/105:46:221
32031995226,11cyclictest0-21swapper/109:13:321
32031995220,26cyclictest21012-21entropy09:51:031
3203099523,45cyclictest0-21swapper/008:22:150
3203099523,44cyclictest0-21swapper/008:31:090
32030995225,12cyclictest0-21swapper/006:05:480
32030995225,12cyclictest0-21swapper/005:31:110
32030995224,12cyclictest0-21swapper/007:02:120
278832523,43sleep20-21swapper/208:22:232
219499520,5rtkit-daemon2193-21rtkit-daemon10:41:033
219499520,5rtkit-daemon2193-21rtkit-daemon10:31:563
219499520,5rtkit-daemon2193-21rtkit-daemon08:02:323
219499520,5rtkit-daemon2193-21rtkit-daemon07:48:033
219499520,5rtkit-daemon2193-21rtkit-daemon07:48:033
199672523,42sleep30-21swapper/309:50:093
199672523,42sleep30-21swapper/309:50:093
3203399517,28cyclictest0-21swapper/308:31:023
3203399514,38cyclictest0-21swapper/310:55:383
32033995126,12cyclictest30792-21munin-node10:56:033
3203299516,10cyclictest27469-21netstat06:26:142
3203299516,10cyclictest27469-21netstat06:26:142
3203299515,30cyclictest0-21swapper/210:51:012
3203299515,30cyclictest0-21swapper/209:42:472
3203299515,29cyclictest0-21swapper/210:24:412
3203299514,38cyclictest0-21swapper/210:37:512
3203299514,35cyclictest0-21swapper/210:28:212
3203299514,35cyclictest0-21swapper/210:28:212
3203299514,30cyclictest0-21swapper/208:40:252
32032995110,24cyclictest11152-21runrttasks08:46:072
3203199514,40cyclictest32658-21crond09:20:411
3203199514,40cyclictest31539-21fschecks_time10:55:551
3203199513,43cyclictest0-21swapper/109:05:571
3203199513,43cyclictest0-21swapper/109:05:571
32031995123,10cyclictest24769-21munin-run07:30:451
32031995111,26cyclictest0-21swapper/108:07:151
3203099513,43cyclictest0-21swapper/006:16:060
32030995124,12cyclictest0-21swapper/006:06:000
32030995123,12cyclictest0-21swapper/006:21:160
32030995117,22cyclictest0-21swapper/007:08:020
232032513,41sleep20-21swapper/207:26:042
219499510,5rtkit-daemon2193-21rtkit-daemon10:49:033
219499510,5rtkit-daemon2193-21rtkit-daemon10:20:423
219499510,5rtkit-daemon2193-21rtkit-daemon10:16:043
219499510,5rtkit-daemon2193-21rtkit-daemon10:06:573
219499510,5rtkit-daemon2193-21rtkit-daemon08:28:313
219499510,5rtkit-daemon2193-21rtkit-daemon08:28:313
219499510,5rtkit-daemon2193-21rtkit-daemon07:50:553
219499510,5rtkit-daemon2193-21rtkit-daemon07:41:033
219499510,5rtkit-daemon2193-21rtkit-daemon06:01:072
219499510,5rtkit-daemon2193-21rtkit-daemon05:36:082
219499510,5rtkit-daemon2193-21rtkit-daemon05:35:232
13702513,42sleep20-21swapper/211:00:302
3203399505,37cyclictest0-21swapper/308:07:533
3203399505,29cyclictest0-21swapper/309:36:023
3203399505,29cyclictest0-21swapper/309:33:313
3203399505,28cyclictest0-21swapper/306:56:223
3203399503,41cyclictest0-21swapper/307:05:563
3203299507,11cyclictest0-21swapper/210:07:212
3203299506,28cyclictest0-21swapper/208:30:582
3203299505,30cyclictest0-21swapper/207:20:092
3203299505,29cyclictest0-21swapper/209:38:482
3203299505,28cyclictest0-21swapper/209:33:522
3203299505,13cyclictest0-21swapper/206:55:462
3203299504,31cyclictest0-21swapper/209:28:492
3203299504,28cyclictest0-21swapper/205:45:502
32032995035,10cyclictest14770-21unixbench_multi07:06:182
32032995019,14cyclictest0-21swapper/207:30:592
32032995010,28cyclictest0-21swapper/210:03:392
3203199503,42cyclictest27027-21munin-node08:21:091
32031995026,12cyclictest0-21swapper/108:45:561
32031995026,12cyclictest0-21swapper/108:29:501
32031995026,12cyclictest0-21swapper/108:29:501
32031995023,10cyclictest3754-21df08:35:561
32031995020,13cyclictest0-21swapper/107:48:141
32031995020,13cyclictest0-21swapper/107:48:141
32030995023,12cyclictest0-21swapper/007:30:450
32030995022,11cyclictest0-21swapper/005:51:100
28072502,9sleep20-21swapper/209:22:182
269962502,9sleep30-21swapper/307:32:133
220362502,9sleep30-21swapper/307:21:413
219499500,5rtkit-daemon2193-21rtkit-daemon08:13:023
219499500,4rtkit-daemon2193-21rtkit-daemon09:56:133
180792503,40sleep20-21swapper/208:07:362
165572503,41sleep10-21swapper/109:44:381
3203399495,36cyclictest0-21swapper/309:06:513
3203399495,36cyclictest0-21swapper/309:06:513
3203399494,30cyclictest0-21swapper/308:23:163
3203399494,29cyclictest0-21swapper/306:36:033
32033994934,9cyclictest597-21grep05:31:093
32033994933,10cyclictest16292-21cut07:11:043
32033994933,10cyclictest16292-21cut07:11:043
3203399493,37cyclictest0-21swapper/308:38:183
3203299495,37cyclictest0-21swapper/207:05:472
3203299495,29cyclictest0-21swapper/206:57:152
3203299495,12cyclictest0-21swapper/208:50:582
3203299494,29cyclictest0-21swapper/206:21:152
3203299493,40cyclictest0-21swapper/207:10:582
3203299493,40cyclictest0-21swapper/207:10:582
3203199493,42cyclictest0-21swapper/109:29:001
3203199493,42cyclictest0-21swapper/108:43:401
3203199493,42cyclictest0-21swapper/108:13:231
32031994927,10cyclictest0-21swapper/106:06:091
32031994924,12cyclictest0-21swapper/107:36:301
32031994923,12cyclictest0-21swapper/106:46:021
32030994928,11cyclictest0-21swapper/005:36:050
32030994922,12cyclictest0-21swapper/006:51:160
32030994921,12cyclictest0-21swapper/005:46:150
217012492,10sleep30-21swapper/306:16:033
3203399484,38cyclictest0-21swapper/309:03:183
3203399484,12cyclictest0-21swapper/306:06:043
32033994834,8cyclictest11523-21sed07:01:073
3203399483,39cyclictest0-21swapper/305:51:083
3203399483,12cyclictest0-21swapper/307:29:373
32033994812,31cyclictest361ktimersoftd/309:20:593
3203299485,29cyclictest0-21swapper/208:16:342
32032994832,10cyclictest19800-21grep06:11:052
3203199489,32cyclictest0-21swapper/109:55:531
32031994822,10cyclictest10525-21munin-node09:36:071
32031994817,15cyclictest0-21swapper/110:54:021
32031994812,30cyclictest27475-21netstat06:26:141
32031994812,30cyclictest27475-21netstat06:26:141
3203099483,39cyclictest11997-21telnet05:56:020
32030994822,9cyclictest20211-21aten_r1power_cu07:20:570
32030994822,11cyclictest0-21swapper/006:56:120
31142483,9sleep00-21swapper/006:43:570
208672483,9sleep10-21swapper/106:11:251
121262482,39sleep10-21swapper/107:01:201
3203399475,36cyclictest0-21swapper/309:19:363
3203399474,19cyclictest0-21swapper/306:55:463
3203299475,27cyclictest0-21swapper/206:31:022
32031994724,11cyclictest0-21swapper/105:40:501
30942472,39sleep10-21swapper/106:43:421
295322472,37sleep10-21swapper/106:31:091
155082472,39sleep10-21swapper/108:05:211
56202462,9sleep30-21swapper/306:50:253
43942462,37sleep30-21swapper/305:39:313
3203399464,27cyclictest0-21swapper/305:44:533
32033994616,13cyclictest0-21swapper/305:48:233
3203299464,37cyclictest0-21swapper/206:16:042
3203299464,36cyclictest0-21swapper/205:30:512
3203299464,32cyclictest0-21swapper/206:45:592
3203299464,25cyclictest0-21swapper/206:41:122
32032994617,13cyclictest0-21swapper/206:40:132
3203199465,35cyclictest31536-21ssh07:40:551
32031994625,10cyclictest0-21swapper/106:36:031
32031994622,11cyclictest0-21swapper/106:20:191
197072462,37sleep30-21swapper/307:17:263
180492463,36sleep10-21swapper/107:15:591
173992465,35sleep117390-21yum-updatesd-he07:13:251
173992465,35sleep117390-21yum-updatesd-he07:13:251
151572462,38sleep10-21swapper/107:10:181
3203399455,29cyclictest0-21swapper/306:20:583
3203399454,34cyclictest0-21swapper/306:41:103
3203399454,33cyclictest0-21swapper/306:31:093
3203199453,13cyclictest0-21swapper/105:31:021
32031994523,10cyclictest0-21swapper/107:00:461
3203199452,37cyclictest0-21swapper/105:56:071
32031994516,12cyclictest0-21swapper/106:55:051
318322454,6sleep00-21swapper/005:28:440
163432452,37sleep10-21swapper/106:04:401
113672452,9sleep10-21swapper/105:51:591
3203399444,32cyclictest16572-21cat06:05:493
3203399444,28cyclictest0-21swapper/305:59:553
3203199443,34cyclictest0-21swapper/107:21:111
32031994415,12cyclictest0-21swapper/106:21:101
3203399425,26cyclictest0-21swapper/305:30:503
32031994020,11cyclictest0-21swapper/105:30:501
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional