You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-29 - 06:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Mon Jun 29, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2786221050,13sleep1940899cyclictest20:26:021
1291321030,3sleep2281ktimersoftd/223:17:292
940799954,83cyclictest0-21swapper/023:46:000
9407999534,54cyclictest2092-21diskmemload22:10:550
9407999534,54cyclictest2092-21diskmemload22:10:550
940799934,33cyclictest0-21swapper/022:56:160
940799933,8cyclictest7575-21unixbench_singl20:46:220
940799913,82cyclictest0-21swapper/022:44:540
940799913,81cyclictest0-21swapper/022:31:210
940799913,38cyclictest0-21swapper/022:06:010
9407999124,12cyclictest0-21swapper/019:41:180
940799904,32cyclictest0-21swapper/000:00:000
940799904,14cyclictest0-21swapper/023:26:270
940799903,37cyclictest0-21swapper/020:56:510
940799893,78cyclictest0-21swapper/021:06:130
940799893,36cyclictest0-21swapper/019:11:160
940799893,32cyclictest0-21swapper/022:01:160
940799884,38cyclictest0-21swapper/023:54:210
940799884,31cyclictest1227-21runrttasks21:21:010
940799883,77cyclictest0-21swapper/023:41:110
940799883,33cyclictest0-21swapper/021:30:570
940799883,32cyclictest0-21swapper/000:00:520
9407998828,7cyclictest5432-21runrttasks22:20:140
9407998824,12cyclictest0-21swapper/023:02:420
940799874,33cyclictest0-21swapper/023:36:090
9407998739,42cyclictest0-21swapper/023:25:200
9407998738,43cyclictest0-21swapper/020:55:430
9407998732,11cyclictest21233-21munin-node21:56:050
940799873,11cyclictest0-21swapper/023:10:420
9407998716,11cyclictest0-21swapper/021:16:010
940799863,39cyclictest0-21swapper/021:51:170
940799863,31cyclictest0-21swapper/023:32:480
940799863,31cyclictest0-21swapper/023:32:480
940799854,33cyclictest0-21swapper/023:11:230
940799854,32cyclictest0-21swapper/021:41:130
9407998532,9cyclictest1466-21rm21:26:020
940799853,34cyclictest0-21swapper/022:21:150
940799853,33cyclictest0-21swapper/022:36:000
31292850,4sleep23133-21fschecks_count22:16:012
219499850,5rtkit-daemon2193-21rtkit-daemon20:48:022
940799844,33cyclictest0-21swapper/021:50:030
940799843,33cyclictest0-21swapper/021:01:210
940799834,32cyclictest0-21swapper/022:26:020
940799833,35cyclictest0-21swapper/021:40:210
940799833,34cyclictest0-21swapper/023:16:030
9407998316,8cyclictest25853-21latency_hist22:50:430
9410998220,14cyclictest0-21swapper/322:36:163
9407998237,39cyclictest0-21swapper/022:51:190
9407998237,39cyclictest0-21swapper/022:51:190
940799823,12cyclictest0-21swapper/000:09:440
9407998124,13cyclictest0-21swapper/021:11:190
9407998034,40cyclictest0-21swapper/019:31:170
9407998034,40cyclictest0-21swapper/019:31:170
9407998020,12cyclictest0-21swapper/019:21:050
940799784,32cyclictest0-21swapper/019:36:030
940799776,34cyclictest0-21swapper/019:16:210
940799753,34cyclictest0-21swapper/020:40:590
9407997421,12cyclictest0-21swapper/019:01:070
219499740,5rtkit-daemon2193-21rtkit-daemon21:50:142
219499740,4rtkit-daemon2193-21rtkit-daemon23:10:342
940799733,32cyclictest808-21munin-run19:30:500
940799733,32cyclictest808-21munin-run19:30:500
940899723,10cyclictest0-21swapper/123:10:501
9407997224,12cyclictest0-21swapper/018:40:540
326872720,3sleep20-21swapper/219:26:222
326872720,3sleep20-21swapper/219:26:222
940999714,38cyclictest0-21swapper/221:34:572
9407997125,12cyclictest0-21swapper/018:56:110
9407997031,5cyclictest0-21swapper/020:09:310
219499690,5rtkit-daemon2193-21rtkit-daemon21:01:162
219499680,5rtkit-daemon2193-21rtkit-daemon23:30:402
940899674,55cyclictest0-21swapper/100:06:021
9407996724,11cyclictest0-21swapper/020:12:130
9407996724,11cyclictest0-21swapper/020:12:130
219499670,5rtkit-daemon2193-21rtkit-daemon21:56:292
219499670,5rtkit-daemon2193-21rtkit-daemon21:41:002
9409996418,16cyclictest0-21swapper/222:40:552
51722633,52sleep20-21swapper/219:36:222
9410996225,27cyclictest7483-21crond21:35:453
940899624,52cyclictest0-21swapper/121:48:361
940899624,52cyclictest0-21swapper/120:52:421
940899624,51cyclictest0-21swapper/121:45:451
940999614,40cyclictest0-21swapper/223:35:562
940999614,29cyclictest0-21swapper/221:20:562
940899614,51cyclictest0-21swapper/123:25:531
940899614,17cyclictest0-21swapper/122:37:201
940999604,38cyclictest0-21swapper/223:04:382
221172605,12sleep30-21swapper/320:11:223
221172605,12sleep30-21swapper/320:11:223
940999594,37cyclictest0-21swapper/223:34:342
940999594,37cyclictest0-21swapper/223:34:342
940899594,48cyclictest28044-21kworker/1:222:16:171
940899593,48cyclictest201ktimersoftd/121:01:011
9408995920,24cyclictest0-21swapper/123:44:051
940999585,31cyclictest0-21swapper/223:14:112
9409995818,25cyclictest25927-21gltestperf20:21:072
9409995812,27cyclictest0-21swapper/200:01:022
940899585,47cyclictest0-21swapper/121:50:561
940899585,46cyclictest0-21swapper/121:30:571
940899584,48cyclictest0-21swapper/123:01:201
940899583,48cyclictest29295-21munin-node22:06:121
940899583,48cyclictest26714-21diskstats22:50:581
940899583,48cyclictest26714-21diskstats22:50:581
940899583,48cyclictest0-21swapper/121:16:141
307492583,12sleep20-21swapper/220:31:082
110892583,47sleep10-21swapper/118:41:231
941099573,48cyclictest0-21swapper/321:01:593
940999576,28cyclictest1227-21runrttasks21:10:362
9409995740,11cyclictest24076-21gltestperf21:11:062
940999574,35cyclictest0-21swapper/221:50:492
940999573,31cyclictest0-21swapper/219:16:232
940899575,46cyclictest0-21swapper/120:45:171
9408995732,11cyclictest0-21swapper/123:20:411
940899573,49cyclictest0-21swapper/121:56:181
222622573,7sleep322291-21mailstats23:31:133
222622573,7sleep322291-21mailstats23:31:133
113932573,11sleep10-21swapper/122:27:221
940999566,26cyclictest0-21swapper/222:55:222
940999566,26cyclictest0-21swapper/222:55:222
940999565,26cyclictest0-21swapper/223:46:262
940999565,26cyclictest0-21swapper/221:18:572
940999565,26cyclictest0-21swapper/220:13:142
940999565,26cyclictest0-21swapper/220:13:142
940999564,27cyclictest0-21swapper/223:22:212
940999564,11cyclictest0-21swapper/222:15:302
940999564,11cyclictest0-21swapper/222:15:302
9409995626,13cyclictest0-21swapper/200:05:552
9409995620,13cyclictest0-21swapper/221:26:022
9409995617,9cyclictest1080-21lldpd21:36:232
9409995616,12cyclictest15000-21taskset22:33:062
940899565,13cyclictest0-21swapper/119:56:131
940899564,47cyclictest0-21swapper/122:14:391
940899564,47cyclictest0-21swapper/122:14:391
940899564,45cyclictest0-21swapper/123:25:011
940899564,45cyclictest0-21swapper/123:10:251
940899563,45cyclictest29860-21munin-node20:31:181
282862563,46sleep10-21swapper/119:18:281
941099553,47cyclictest0-21swapper/323:05:313
941099553,45cyclictest25512-21munin-node22:01:053
941099553,44cyclictest31106-21sort22:56:143
9410995523,13cyclictest0-21swapper/320:54:503
9410995521,14cyclictest0-21swapper/320:58:333
940999556,25cyclictest0-21swapper/223:55:512
940999555,29cyclictest0-21swapper/222:35:552
940999555,26cyclictest0-21swapper/220:56:172
940999554,32cyclictest0-21swapper/222:21:152
940999554,24cyclictest0-21swapper/222:46:422
9409995539,10cyclictest6632-21fschecks_count19:41:082
9409995524,11cyclictest2092-21diskmemload23:41:002
9409995522,13cyclictest0-21swapper/220:26:162
9409995521,14cyclictest0-21swapper/219:21:242
9409995519,15cyclictest0-21swapper/218:51:082
9409995519,14cyclictest0-21swapper/219:56:192
9409995517,12cyclictest0-21swapper/220:51:132
9409995515,12cyclictest31070-21ssh22:10:432
940899555,44cyclictest0-21swapper/122:49:491
940899554,45cyclictest0-21swapper/123:32:091
940899554,45cyclictest0-21swapper/123:32:091
940899554,44cyclictest0-21swapper/122:20:541
940899554,44cyclictest0-21swapper/121:21:001
940899554,44cyclictest0-21swapper/121:07:151
940899553,45cyclictest3947-21rm23:51:401
940899553,45cyclictest13569-21idleruntime22:31:051
219499550,4rtkit-daemon2193-21rtkit-daemon23:51:092
176912555,43sleep10-21swapper/120:05:481
941099543,46cyclictest0-21swapper/322:20:553
940999545,28cyclictest0-21swapper/219:11:062
940999544,28cyclictest0-21swapper/219:51:062
940999544,27cyclictest18781-21gltestperf20:06:082
940999544,27cyclictest0-21swapper/222:58:132
940999544,26cyclictest0-21swapper/222:29:092
940999544,22cyclictest0-21swapper/218:56:142
9409995418,11cyclictest2075-21kworker/2:220:41:042
9409995414,22cyclictest0-21swapper/222:01:112
940899545,41cyclictest25136-21ssh21:11:411
940899544,44cyclictest0-21swapper/122:40:511
940899544,44cyclictest0-21swapper/121:26:191
940899544,14cyclictest0-21swapper/123:47:481
940899544,13cyclictest0-21swapper/100:04:441
940899544,12cyclictest0-21swapper/120:49:071
940899543,44cyclictest9871-21ssh21:37:101
940899543,44cyclictest7319-21rm23:56:411
236892543,12sleep10-21swapper/119:10:461
174062542,10sleep30-21swapper/320:02:073
941099534,31cyclictest0-21swapper/323:56:213
941099533,10cyclictest5936-21cpu20:46:003
9410995325,13cyclictest0-21swapper/322:31:113
940999535,29cyclictest0-21swapper/220:15:592
940999535,29cyclictest0-21swapper/219:31:022
940999535,29cyclictest0-21swapper/219:31:022
940999535,28cyclictest0-21swapper/218:41:142
940999534,28cyclictest0-21swapper/219:01:132
940999533,26cyclictest0-21swapper/219:46:102
9409995319,15cyclictest0-21swapper/218:47:352
9409995319,15cyclictest0-21swapper/218:47:352
940899535,26cyclictest0-21swapper/123:36:111
940899533,44cyclictest0-21swapper/119:28:351
940899533,44cyclictest0-21swapper/119:28:351
315762533,44sleep131580-21ssh22:57:011
103212532,10sleep30-21swapper/319:48:043
941099525,31cyclictest0-21swapper/322:10:463
941099525,31cyclictest0-21swapper/322:10:463
941099523,43cyclictest0-21swapper/323:40:523
941099523,42cyclictest19747-21munin-node21:06:163
9410995223,12cyclictest0-21swapper/320:43:373
940999524,28cyclictest0-21swapper/220:01:022
940999524,27cyclictest0-21swapper/220:35:592
940999524,26cyclictest0-21swapper/219:07:382
940899524,43cyclictest0-21swapper/122:01:191
940899524,29cyclictest0-21swapper/119:46:001
940899523,9cyclictest0-21swapper/120:58:201
55542522,10sleep30-21swapper/319:38:133
245992522,7sleep31124-21snmpd20:17:393
219499520,5rtkit-daemon2193-21rtkit-daemon21:21:083
219499520,5rtkit-daemon2193-21rtkit-daemon21:16:013
141432523,43sleep10-21swapper/118:50:421
141432523,43sleep10-21swapper/118:50:421
941099514,39cyclictest10014-21ssh23:14:103
941099513,41cyclictest0-21swapper/323:19:163
941099513,40cyclictest0-21swapper/323:20:533
941099513,27cyclictest0-21swapper/323:37:123
9410995121,13cyclictest0-21swapper/323:10:273
9407995132,13cyclictest0-21swapper/020:00:490
87502518,35sleep00-21swapper/018:36:200
221892513,42sleep10-21swapper/120:12:171
221892513,42sleep10-21swapper/120:12:171
9410995032,11cyclictest2318-21cpuspeed_turbos23:50:533
941099503,41cyclictest0-21swapper/319:56:013
941099503,28cyclictest0-21swapper/322:45:123
941099503,27cyclictest0-21swapper/319:11:213
941099503,26cyclictest0-21swapper/322:06:423
9410995023,7cyclictest9700-21runrttasks00:01:013
9410995019,11cyclictest18853-21hwlatdetect20:06:093
940899505,39cyclictest0-21swapper/120:06:161
940899505,38cyclictest0-21swapper/119:11:141
6392503,6sleep3643-21sh23:47:343
941099499,24cyclictest0-21swapper/321:53:543
941099495,38cyclictest0-21swapper/323:26:133
9410994933,10cyclictest30381-21unixbench-2d19:21:233
941099493,28cyclictest0-21swapper/321:55:583
941099493,28cyclictest0-21swapper/321:41:203
941099493,25cyclictest0-21swapper/322:30:163
9410994922,9cyclictest14473-21ssh21:45:503
9410994918,14cyclictest0-21swapper/321:25:583
940899495,14cyclictest0-21swapper/119:02:371
9407994919,14cyclictest0-21swapper/020:18:530
296742493,38sleep30-21swapper/320:30:493
155452494,38sleep00-21swapper/020:00:590
9410994832,10cyclictest27798-21cpuspeed_turbos20:26:023
9410994831,11cyclictest31900-21gltestperf19:26:093
9410994831,11cyclictest31900-21gltestperf19:26:093
9410994825,10cyclictest0-21swapper/322:16:543
9410994822,9cyclictest19411-21kworker/3:222:51:093
9410994822,9cyclictest19411-21kworker/3:222:51:093
9410994821,9cyclictest1084-21lldpd00:05:533
940899485,12cyclictest2084-21crond20:40:461
9408994835,8cyclictest15259-21gltestperf18:51:111
940899482,23cyclictest25090-21munin-node20:21:081
305982483,39sleep10-21swapper/119:22:271
9410994731,9cyclictest18490-21unixbench_multi18:56:243
9410994723,9cyclictest12008-21munin-node18:46:203
9410994723,9cyclictest12008-21munin-node18:46:203
9410994721,8cyclictest24092-21ntp_states22:46:113
9410994721,11cyclictest26384-21telnet19:16:023
9408994716,13cyclictest0-21swapper/118:56:031
269252472,39sleep30-21swapper/320:21:463
260032472,39sleep30-21swapper/321:14:513
941099467,23cyclictest0-21swapper/321:35:473
9410994631,9cyclictest1047-21cut20:36:133
941099463,27cyclictest0-21swapper/319:01:173
9410994615,10cyclictest14459-21telnet18:51:033
940899464,32cyclictest0-21swapper/119:35:551
9407994628,12cyclictest0-21swapper/020:40:470
101662464,36sleep00-21swapper/019:46:240
9410994522,8cyclictest22272-21perl19:06:103
9410994520,10cyclictest7445-21python19:41:213
940899454,34cyclictest0-21swapper/119:32:431
940899454,34cyclictest0-21swapper/119:32:431
940899453,36cyclictest0-21swapper/120:20:491
9408994525,15cyclictest0-21swapper/119:55:481
940799453,36cyclictest0-21swapper/019:06:130
940799453,35cyclictest0-21swapper/018:51:220
98232442,34sleep30-21swapper/318:41:053
940899443,23cyclictest0-21swapper/119:41:211
940799443,35cyclictest0-21swapper/020:21:170
9407994425,12cyclictest0-21swapper/019:51:100
941099432,36cyclictest0-21swapper/319:31:113
941099432,36cyclictest0-21swapper/319:31:113
940799433,12cyclictest0-21swapper/020:31:030
9407994321,11cyclictest0-21swapper/020:26:010
93512434,32sleep10-21swapper/118:40:351
940999424,12cyclictest0-21swapper/218:40:522
941099413,11cyclictest11495-21perl19:51:073
941099404,30cyclictest0-21swapper/318:40:523
940799403,33cyclictest0-21swapper/018:46:120
940799403,33cyclictest0-21swapper/018:46:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional