You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-15 - 10:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sun Mar 15, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1123621100,3sleep3361ktimersoftd/323:09:063
256792950,2sleep00-21swapper/021:55:090
154512810,4sleep015-21rcuc/021:39:290
296152790,4sleep337-21ksoftirqd/322:02:183
248599740,4rtkit-daemon2484-21rtkit-daemon21:57:183
7944997213,51cyclictest0-21swapper/321:29:003
7942997141,13cyclictest0-21swapper/122:35:521
794499686,54cyclictest1419-21runrttasks19:46:033
7944996611,48cyclictest0-21swapper/320:33:483
7942996641,11cyclictest0-21swapper/120:19:071
7942996640,12cyclictest0-21swapper/121:19:081
7942996639,12cyclictest0-21swapper/122:48:441
7940996612,36cyclictest8312-21rm22:18:480
794499654,53cyclictest0-21swapper/321:38:363
794499654,53cyclictest0-21swapper/321:38:363
794099655,37cyclictest0-21swapper/021:48:100
794499645,51cyclictest0-21swapper/322:29:023
7943996446,12cyclictest0-21swapper/221:14:032
7942996422,25cyclictest6391-21unixbench-2d22:14:071
169432643,12sleep30-21swapper/320:54:053
169432643,12sleep30-21swapper/320:54:053
7942996336,13cyclictest0-21swapper/120:40:131
794499622,54cyclictest0-21swapper/321:48:113
7942996238,11cyclictest0-21swapper/121:54:081
7942996218,27cyclictest0-21swapper/120:54:191
7942996218,27cyclictest0-21swapper/120:54:191
248599620,5rtkit-daemon2484-21rtkit-daemon20:03:152
794499614,51cyclictest0-21swapper/320:27:073
794499614,14cyclictest0-21swapper/322:24:063
794299614,50cyclictest0-21swapper/122:24:021
7942996139,11cyclictest0-21swapper/120:07:021
7942996136,10cyclictest0-21swapper/120:48:581
794099615,39cyclictest0-21swapper/022:27:050
794099615,38cyclictest1419-21runrttasks20:33:300
45032610,6sleep24504-21wc19:49:002
794499606,47cyclictest1419-21runrttasks22:48:013
794499604,49cyclictest0-21swapper/322:33:453
794499603,52cyclictest0-21swapper/320:30:283
7943996041,12cyclictest0-21swapper/220:48:572
794399603,49cyclictest0-21swapper/218:08:542
794399603,49cyclictest0-21swapper/218:08:542
7942996038,10cyclictest0-21swapper/122:43:231
7942996037,9cyclictest16826-21taskset21:43:441
7942996037,11cyclictest0-21swapper/122:07:461
7940996022,14cyclictest1419-21runrttasks23:04:210
7940996010,7cyclictest41ktimersoftd/020:18:550
20492603,12sleep20-21swapper/222:57:532
20492603,12sleep20-21swapper/222:57:532
7943995937,14cyclictest0-21swapper/222:20:482
7942995937,11cyclictest0-21swapper/120:01:141
7942995937,10cyclictest0-21swapper/119:53:511
7942995936,12cyclictest0-21swapper/120:30:061
7942995936,11cyclictest0-21swapper/122:02:281
7942995936,11cyclictest0-21swapper/121:16:051
7942995912,24cyclictest0-21swapper/121:08:591
267812594,12sleep00-21swapper/019:29:120
248599590,4rtkit-daemon2484-21rtkit-daemon21:04:133
228722593,10sleep022964-21memory18:14:070
162792594,13sleep20-21swapper/221:42:342
794399583,47cyclictest0-21swapper/220:34:072
794299584,30cyclictest0-21swapper/121:34:051
794299584,30cyclictest0-21swapper/121:34:051
7942995835,11cyclictest0-21swapper/122:59:021
794099585,36cyclictest0-21swapper/020:17:150
794099585,36cyclictest0-21swapper/020:17:150
7940995840,11cyclictest6428-21tail22:14:070
794099584,35cyclictest0-21swapper/021:18:500
7940995822,20cyclictest0-21swapper/022:34:440
226242583,7sleep022631-21latency_hist19:23:400
794499576,34cyclictest0-21swapper/320:01:273
794499574,8cyclictest18919-21munin-node20:59:093
794499574,13cyclictest0-21swapper/322:54:003
794499574,13cyclictest0-21swapper/322:54:003
794499573,9cyclictest5898-21needreboot22:13:593
794499573,13cyclictest0-21swapper/322:49:033
7944995717,22cyclictest0-21swapper/319:48:503
7944995713,8cyclictest73732sleep320:39:223
794399573,47cyclictest22389-21ssh21:50:222
7942995743,8cyclictest23875-21timerandwakeup21:04:081
7942995737,8cyclictest20501-21aten2.4-expect19:18:511
7942995736,10cyclictest0-21swapper/120:45:221
212742573,46sleep20-21swapper/221:00:582
794499564,35cyclictest0-21swapper/322:21:293
794499564,13cyclictest0-21swapper/320:03:523
794499564,12cyclictest0-21swapper/322:08:363
794399564,45cyclictest0-21swapper/222:49:022
794399564,44cyclictest0-21swapper/222:43:482
7943995637,13cyclictest0-21swapper/221:59:562
794399563,47cyclictest0-21swapper/220:56:442
794399563,47cyclictest0-21swapper/220:56:442
794399563,46cyclictest0-21swapper/223:08:482
7942995634,11cyclictest0-21swapper/120:26:081
7942995634,10cyclictest0-21swapper/120:14:091
7942995634,10cyclictest0-21swapper/120:14:091
794099564,45cyclictest0-21swapper/022:43:460
794099564,31cyclictest0-21swapper/020:58:370
794099564,31cyclictest0-21swapper/020:58:370
7940995611,26cyclictest0-21swapper/020:38:590
40872563,12sleep20-21swapper/221:23:562
149962563,46sleep00-21swapper/020:52:370
120072563,10sleep00-21swapper/023:11:580
794499554,39cyclictest0-21swapper/318:15:093
794499554,12cyclictest0-21swapper/323:08:273
794399555,42cyclictest0-21swapper/222:34:072
7943995537,12cyclictest0-21swapper/221:48:352
7943995536,12cyclictest0-21swapper/222:04:052
7943995525,13cyclictest0-21swapper/217:56:012
794299556,29cyclictest0-21swapper/121:24:071
7942995535,13cyclictest0-21swapper/120:09:101
794099553,36cyclictest0-21swapper/022:30:590
7940995523,13cyclictest0-21swapper/020:07:210
7940995522,14cyclictest0-21swapper/020:44:050
248599550,6rtkit-daemon2484-21rtkit-daemon17:40:362
248599550,5rtkit-daemon2484-21rtkit-daemon19:34:013
90072543,8sleep19010-21ssh21:30:361
794499545,31cyclictest0-21swapper/321:13:473
794499544,31cyclictest0-21swapper/318:04:133
7944995434,12cyclictest26837-21tr18:23:553
7944995426,13cyclictest0-21swapper/321:27:083
7944995420,15cyclictest0-21swapper/322:42:033
7944995420,12cyclictest0-21swapper/321:23:093
794499542,9cyclictest0-21swapper/317:49:023
794399544,45cyclictest0-21swapper/221:22:382
794399544,43cyclictest0-21swapper/221:08:582
7943995438,11cyclictest0-21swapper/222:28:482
7943995427,13cyclictest0-21swapper/222:17:252
794299544,45cyclictest0-21swapper/123:09:331
794299544,37cyclictest0-21swapper/122:09:591
794299543,35cyclictest0-21swapper/121:50:401
794099545,32cyclictest0-21swapper/021:29:070
794099545,31cyclictest0-21swapper/021:13:570
794099545,29cyclictest0-21swapper/021:59:070
7940995434,13cyclictest0-21swapper/020:23:510
794099543,35cyclictest0-21swapper/019:44:540
7940995421,13cyclictest0-21swapper/022:38:490
7940995420,14cyclictest0-21swapper/018:29:040
65562543,13sleep00-21swapper/019:53:020
43392543,12sleep20-21swapper/222:13:262
794499535,28cyclictest0-21swapper/321:40:253
794499535,28cyclictest0-21swapper/318:38:433
794499534,9cyclictest27146-21python21:09:083
7944995321,14cyclictest0-21swapper/320:50:163
7944995320,14cyclictest0-21swapper/322:04:013
7944995319,15cyclictest0-21swapper/317:55:053
7944995319,14cyclictest0-21swapper/318:03:443
7944995318,16cyclictest0-21swapper/320:44:013
7944995317,16cyclictest0-21swapper/321:49:493
794299533,44cyclictest31815-21sed18:33:571
794099536,42cyclictest0-21swapper/021:53:320
794099536,24cyclictest0-21swapper/022:03:480
794099535,42cyclictest0-21swapper/018:51:080
794099535,42cyclictest0-21swapper/018:51:080
794099535,28cyclictest0-21swapper/021:03:550
794099535,28cyclictest0-21swapper/019:38:590
794099535,28cyclictest0-21swapper/018:35:010
794099534,29cyclictest0-21swapper/020:13:290
794099534,28cyclictest0-21swapper/022:58:320
794099534,28cyclictest0-21swapper/022:58:320
794099534,24cyclictest0-21swapper/022:49:000
7940995313,32cyclictest0-21swapper/019:13:510
248599530,5rtkit-daemon2484-21rtkit-daemon23:03:462
248599530,5rtkit-daemon2484-21rtkit-daemon20:09:002
214862533,9sleep00-21swapper/021:01:440
165612533,9sleep00-21swapper/018:00:160
105082533,43sleep00-21swapper/019:58:430
794499525,28cyclictest0-21swapper/320:09:263
794499524,28cyclictest0-21swapper/319:53:503
794499524,10cyclictest17257-21kworker/3:120:14:113
794499524,10cyclictest17257-21kworker/3:120:14:113
794499523,44cyclictest0-21swapper/318:43:533
7944995217,15cyclictest0-21swapper/319:39:073
794399525,40cyclictest0-21swapper/220:14:042
794399525,40cyclictest0-21swapper/220:14:042
7943995237,10cyclictest0-21swapper/220:07:542
7943995234,12cyclictest0-21swapper/218:13:582
794399523,41cyclictest0-21swapper/221:33:532
794399523,41cyclictest0-21swapper/221:33:532
794299529,23cyclictest0-21swapper/123:04:411
794299524,42cyclictest0-21swapper/122:46:051
794299524,27cyclictest0-21swapper/121:40:101
7942995233,13cyclictest0-21swapper/122:20:211
794299523,8cyclictest17737-21ssh22:33:121
794299523,31cyclictest0-21swapper/117:48:571
7942995222,13cyclictest0-21swapper/120:36:231
7942995222,12cyclictest0-21swapper/119:48:521
794099525,27cyclictest0-21swapper/019:23:590
794099525,27cyclictest0-21swapper/018:23:520
794099524,41cyclictest0-21swapper/021:24:010
794099524,29cyclictest0-21swapper/022:58:520
794099524,27cyclictest0-21swapper/019:33:590
248599520,5rtkit-daemon2484-21rtkit-daemon20:27:142
248599520,5rtkit-daemon2484-21rtkit-daemon19:56:232
124182523,42sleep00-21swapper/021:35:430
124182523,42sleep00-21swapper/021:35:430
794499516,27cyclictest0-21swapper/319:05:183
794499516,26cyclictest0-21swapper/320:19:073
794499515,28cyclictest0-21swapper/319:23:593
794499515,27cyclictest0-21swapper/317:44:123
794499514,28cyclictest0-21swapper/318:59:053
794499514,28cyclictest0-21swapper/318:55:163
794499514,27cyclictest0-21swapper/318:08:543
794499514,27cyclictest0-21swapper/318:08:543
7944995116,15cyclictest0-21swapper/322:59:103
794399517,27cyclictest0-21swapper/221:04:482
794399515,27cyclictest0-21swapper/222:28:352
794399514,41cyclictest0-21swapper/220:44:042
7943995136,9cyclictest9881-21latency_hist21:33:362
7943995130,14cyclictest0-21swapper/220:38:472
794299514,29cyclictest0-21swapper/119:28:521
794299514,29cyclictest0-21swapper/118:54:041
794299514,28cyclictest0-21swapper/119:24:141
794299514,28cyclictest0-21swapper/119:13:411
794299514,28cyclictest0-21swapper/118:44:081
794299514,28cyclictest0-21swapper/118:29:121
794299513,43cyclictest0-21swapper/117:44:401
794299513,35cyclictest0-21swapper/119:43:561
794299513,12cyclictest0-21swapper/122:54:031
794299513,12cyclictest0-21swapper/122:54:031
794099516,25cyclictest0-21swapper/019:53:550
794099515,27cyclictest0-21swapper/021:08:580
794099515,14cyclictest0-21swapper/022:08:470
794099514,27cyclictest0-21swapper/019:03:490
7940995121,12cyclictest0-21swapper/020:37:460
77752513,41sleep27878-21tail18:49:162
77752513,41sleep27878-21tail18:49:162
34362513,42sleep00-21swapper/018:42:330
259942512,9sleep10-21swapper/118:20:281
794499503,28cyclictest0-21swapper/318:29:113
794499503,10cyclictest0-21swapper/319:09:053
7944995019,11cyclictest26128-21gltestperf19:28:593
794399507,38cyclictest0-21swapper/219:47:432
794399505,38cyclictest0-21swapper/222:58:492
794399505,37cyclictest0-21swapper/219:29:012
7943995023,10cyclictest23886-21tr21:53:472
7943995021,13cyclictest0-21swapper/220:18:522
794299503,29cyclictest0-21swapper/120:58:511
794299503,28cyclictest0-21swapper/118:39:131
794299503,10cyclictest0-21swapper/118:09:001
794299503,10cyclictest0-21swapper/118:09:001
794099504,38cyclictest0-21swapper/018:43:520
7940995019,12cyclictest0-21swapper/018:08:440
285982502,9sleep20-21swapper/219:34:022
260132503,41sleep00-21swapper/018:20:440
212742503,9sleep00-21swapper/018:09:310
212742503,9sleep00-21swapper/018:09:310
794499495,14cyclictest0-21swapper/318:48:543
794499495,14cyclictest0-21swapper/318:48:543
794499494,27cyclictest0-21swapper/318:20:103
794399497,25cyclictest0-21swapper/217:44:152
794399495,38cyclictest0-21swapper/222:39:052
794399495,37cyclictest0-21swapper/220:29:002
7943994928,14cyclictest0-21swapper/217:59:022
794299495,25cyclictest0-21swapper/119:40:581
794099495,35cyclictest0-21swapper/018:53:530
98272483,9sleep00-21swapper/017:45:160
7943994821,12cyclictest0-21swapper/218:28:532
7943994820,10cyclictest20244-21latency_hist19:18:412
794299484,28cyclictest0-21swapper/119:16:251
794299484,27cyclictest0-21swapper/117:59:001
794299484,25cyclictest0-21swapper/118:04:001
794099484,27cyclictest0-21swapper/017:53:590
794499475,13cyclictest0-21swapper/319:13:593
794499473,27cyclictest0-21swapper/318:39:103
794399474,37cyclictest0-21swapper/219:23:402
794399474,37cyclictest0-21swapper/219:13:402
7943994731,10cyclictest23174-21cut19:23:542
794399473,40cyclictest0-21swapper/218:19:312
7943994721,8cyclictest7901-21kworker/2:018:43:532
794299474,28cyclictest0-21swapper/117:54:061
794299474,26cyclictest0-21swapper/118:49:031
794299474,26cyclictest0-21swapper/118:49:031
794299474,26cyclictest0-21swapper/118:25:101
7942994729,12cyclictest0-21swapper/119:33:561
7942994717,13cyclictest0-21swapper/118:59:321
794099475,26cyclictest0-21swapper/019:00:170
7940994730,10cyclictest17408-21grep19:09:140
7940994714,24cyclictest0-21swapper/017:48:570
152732472,39sleep10-21swapper/119:06:121
794399468,32cyclictest3542-21awk18:43:422
794399465,35cyclictest0-21swapper/218:54:042
7943994616,12cyclictest0-21swapper/217:48:562
77742464,33sleep10-21swapper/117:42:041
75902464,7sleep30-21swapper/317:39:403
7944994515,13cyclictest0-21swapper/319:19:023
7943994531,10cyclictest0-21swapper/218:59:102
7943994530,11cyclictest0-21swapper/218:38:382
7943994523,10cyclictest0-21swapper/219:39:042
7943994513,25cyclictest0-21swapper/219:04:012
794299453,25cyclictest0-21swapper/118:14:001
794399444,34cyclictest1419-21runrttasks18:23:522
794399415,31cyclictest0-21swapper/218:07:362
7940994128,7cyclictest7989-21latency_hist17:43:450
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional