You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-08 - 02:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed Jul 08, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991320,11rtkit-daemon0-21swapper/223:52:172
22911991054,12cyclictest0-21swapper/020:37:500
22917991034,28cyclictest0-21swapper/319:47:223
22911991003,12cyclictest0-21swapper/023:17:420
22917999821,15cyclictest29729-21fschecks_time23:17:313
2291199974,11cyclictest0-21swapper/022:02:360
2291699957,78cyclictest0-21swapper/222:55:512
2291199953,11cyclictest0-21swapper/021:32:320
2291799946,26cyclictest9334-21diskstats22:47:313
2291699949,68cyclictest8766-21mailstats21:57:452
2291699944,70cyclictest0-21swapper/223:27:532
2291699937,61cyclictest1-21systemd20:37:322
2291799924,29cyclictest0-21swapper/322:12:333
2291699923,55cyclictest0-21swapper/223:21:302
2291799919,27cyclictest0-21swapper/320:46:483
2291799915,25cyclictest1124-21snmpd22:44:473
2291699915,53cyclictest0-21swapper/222:44:202
2291699914,50cyclictest0-21swapper/223:00:132
2291799905,29cyclictest0-21swapper/322:09:423
2291799905,28cyclictest0-21swapper/321:22:373
22917999020,14cyclictest0-21swapper/322:40:253
2291699909,48cyclictest0-21swapper/223:05:132
2291699903,63cyclictest0-21swapper/221:52:272
2291699903,62cyclictest24154-21processes21:32:462
2291699903,54cyclictest0-21swapper/222:03:502
2291799896,23cyclictest7410-21aten_r1power_vo21:57:273
2291799894,32cyclictest0-21swapper/320:37:313
22917998934,47cyclictest0-21swapper/321:52:333
22917998931,9cyclictest12976-21gltestperf22:52:313
22917998924,15cyclictest0-21swapper/323:32:263
2291699896,63cyclictest0-21swapper/220:52:202
2291799885,15cyclictest0-21swapper/321:17:333
2291699886,75cyclictest0-21swapper/222:13:572
2291799879,12cyclictest23962-21cpuspeed23:57:253
2291799876,25cyclictest0-21swapper/322:28:413
2291799876,25cyclictest0-21swapper/322:28:413
2291799875,30cyclictest4666-21ls23:27:373
2291799874,23cyclictest0-21swapper/321:32:353
22917998732,10cyclictest11436-21fschecks_time22:02:343
22917998731,49cyclictest0-21swapper/321:47:003
2291799864,32cyclictest11010-21grep21:12:523
2291799864,32cyclictest11010-21grep21:12:523
22917998632,10cyclictest14239-21aten_r1power_en20:32:313
22917998632,10cyclictest14239-21aten_r1power_en20:32:313
2291799863,14cyclictest668-21wc21:47:313
2291799863,14cyclictest668-21wc21:47:313
22917998628,12cyclictest835-21rm20:58:043
2291699864,11cyclictest0-21swapper/220:43:572
2291699863,76cyclictest0-21swapper/223:10:142
2291699863,6cyclictest15528-21ssh22:07:502
2291699863,13cyclictest0-21swapper/222:32:382
2291699863,11cyclictest0-21swapper/220:57:302
22916998614,48cyclictest7289-21gzip21:07:482
22916998614,48cyclictest7289-21gzip21:07:482
2291799855,74cyclictest0-21swapper/321:07:183
2291799854,29cyclictest0-21swapper/323:27:133
2291799854,25cyclictest0-21swapper/323:12:473
2291799854,22cyclictest0-21swapper/323:37:343
22917998531,47cyclictest0-21swapper/322:22:433
2291799853,24cyclictest0-21swapper/323:11:043
2291799853,21cyclictest15536-21ssh22:57:253
22917998518,12cyclictest0-21swapper/321:07:523
22917998518,12cyclictest0-21swapper/321:07:523
22917998511,10cyclictest107550irq/46-eth020:47:403
2291699854,7cyclictest15955-21aten_r1power_cu21:22:292
2291699854,12cyclictest0-21swapper/223:44:042
2291699853,7cyclictest13925-21diskmemload23:32:352
2291699853,64cyclictest0-21swapper/221:49:332
2291699853,64cyclictest0-21swapper/221:49:332
2291699853,11cyclictest0-21swapper/220:02:312
22916998518,48cyclictest0-21swapper/222:22:352
2291799844,13cyclictest29711-21ssh20:52:543
2291799844,13cyclictest0-21swapper/323:47:233
2291799844,13cyclictest0-21swapper/322:19:113
22917998431,12cyclictest0-21swapper/321:28:153
22917998427,11cyclictest6116-21cpuspeed_turbos20:12:333
22917998421,8cyclictest1612-21turbostat.cron22:37:143
22917998410,9cyclictest107550irq/46-eth019:18:413
2291699844,74cyclictest0-21swapper/221:45:342
2291699844,11cyclictest0-21swapper/223:57:392
2291699843,11cyclictest0-21swapper/218:42:342
2291699843,10cyclictest0-21swapper/221:12:512
2291699843,10cyclictest0-21swapper/221:12:512
2291699843,10cyclictest0-21swapper/221:02:352
22916998411,60cyclictest0-21swapper/219:12:342
2291799834,14cyclictest15076-21munin-node23:42:403
22917998333,12cyclictest4105-21fschecks_time20:07:393
22917998327,10cyclictest9327-21unixbench_singl19:07:573
2291699837,53cyclictest0-21swapper/222:41:502
2291699835,62cyclictest0-21swapper/221:17:342
2291699833,56cyclictest24826-21df_abs20:47:352
2291699833,11cyclictest0-21swapper/223:49:532
2291699833,11cyclictest0-21swapper/223:16:132
2291699833,11cyclictest0-21swapper/220:27:422
2291799827,12cyclictest0-21swapper/323:04:113
2291799825,31cyclictest0-21swapper/318:37:553
22917998225,12cyclictest21776-21processes23:52:403
2291699825,55cyclictest910-21if_eth023:22:352
2291699824,10cyclictest0-21swapper/222:47:362
2291699823,11cyclictest0-21swapper/222:27:292
2291699823,11cyclictest0-21swapper/222:27:292
2291699823,11cyclictest0-21swapper/221:37:322
22916998214,45cyclictest13047-21ssh23:41:182
2291799814,34cyclictest0-21swapper/319:02:233
2291799814,15cyclictest0-21swapper/320:18:513
22917998127,10cyclictest16127-21sendmail_mailqu19:22:513
22917998125,11cyclictest26721-21fschecks_count21:37:363
22917998124,12cyclictest13478-21unixbench_multi20:27:513
22917998119,11cyclictest28591-21head19:52:333
22917998119,11cyclictest28591-21head19:52:333
22917998118,12cyclictest0-21swapper/318:33:333
22916998110,50cyclictest0-21swapper/218:57:462
2291799808,14cyclictest0-21swapper/318:47:413
2291799804,13cyclictest0-21swapper/319:47:233
2291799804,13cyclictest0-21swapper/319:47:233
22917998024,12cyclictest6375-21needreboot19:02:473
22917998020,12cyclictest0-21swapper/318:42:363
22917998011,18cyclictest0-21swapper/319:42:223
2291699803,8cyclictest1227-21runrttasks19:51:002
2291699803,8cyclictest1227-21runrttasks19:51:002
2291699803,55cyclictest0-21swapper/221:27:392
2291699803,11cyclictest0-21swapper/222:17:512
2291799793,11cyclictest18529-21runrttasks19:27:583
2291699794,51cyclictest0-21swapper/218:38:022
2291699794,11cyclictest0-21swapper/219:32:212
2291699793,8cyclictest32543-21cat19:57:532
2291699793,8cyclictest12710-21chrt19:17:372
2291699793,11cyclictest0-21swapper/220:32:512
2291699793,11cyclictest0-21swapper/220:32:512
22916997916,43cyclictest0-21swapper/219:47:212
22917997812,9cyclictest107550irq/46-eth019:32:353
2291699784,11cyclictest0-21swapper/218:32:242
2291699784,11cyclictest0-21swapper/218:32:242
2291699783,9cyclictest2540-21crond18:57:222
288192770,3sleep2281ktimersoftd/219:52:362
288192770,3sleep2281ktimersoftd/219:52:362
2291799774,14cyclictest0-21swapper/318:52:463
2291799773,28cyclictest9945-21munin-node19:12:583
2291799773,21cyclictest31939-21iostat_ios19:57:433
2291799764,14cyclictest0-21swapper/320:02:483
2291799757,19cyclictest0-21swapper/320:27:203
2291699753,11cyclictest0-21swapper/219:37:352
2291699753,11cyclictest0-21swapper/219:07:562
2291699743,11cyclictest0-21swapper/218:32:392
22916997418,36cyclictest14838-21telnet19:22:332
2291699734,8cyclictest5546-21yum-updatesd-he20:12:202
2291699733,10cyclictest0-21swapper/220:22:362
22911997327,13cyclictest0-21swapper/018:42:420
22911997317,48cyclictest20704-21grep23:52:250
2291699723,11cyclictest0-21swapper/220:19:372
2291699723,11cyclictest0-21swapper/219:37:212
2291699713,12cyclictest0-21swapper/219:02:412
22916997121,33cyclictest32439-21latency_hist18:52:242
2291799698,17cyclictest0-21swapper/318:32:253
2291799698,17cyclictest0-21swapper/318:32:253
2291699683,12cyclictest0-21swapper/220:12:422
2291599674,56cyclictest0-21swapper/121:07:351
2291599674,56cyclictest0-21swapper/121:07:351
22911996734,11cyclictest17139-21crond22:12:150
2291199664,13cyclictest0-21swapper/023:37:380
2291199664,12cyclictest0-21swapper/022:42:250
219499650,5rtkit-daemon0-21swapper/118:32:450
22915996124,31cyclictest24360-21fschecks_count23:57:291
2291199614,28cyclictest0-21swapper/023:42:330
22911996135,9cyclictest8715-21ssh23:32:490
2291199613,13cyclictest0-21swapper/022:36:300
259172604,48sleep00-21swapper/018:37:420
22915996016,25cyclictest15689-21systemd-cgroups21:22:171
2291199604,49cyclictest0-21swapper/023:12:130
2291599595,47cyclictest0-21swapper/123:47:391
2291599595,36cyclictest0-21swapper/123:22:421
22915995918,12cyclictest0-21swapper/119:32:421
2291199593,11cyclictest0-21swapper/022:12:220
22911995917,10cyclictest0-21swapper/019:02:490
219499590,5rtkit-daemon0-21swapper/100:01:170
2291599584,11cyclictest7178-21cpuspeed_turbos23:32:261
2291599583,9cyclictest11103-21df_abs22:02:301
22915995818,23cyclictest0-21swapper/121:32:381
2291199583,11cyclictest0-21swapper/021:52:500
22911995826,18cyclictest14595-21ssh22:55:030
2291599574,46cyclictest0-21swapper/121:37:461
2291599574,24cyclictest18803-21grep20:37:491
2291199576,11cyclictest0-21swapper/021:17:470
2291199574,13cyclictest0-21swapper/018:47:390
2291199573,10cyclictest0-21swapper/022:22:260
219499570,6rtkit-daemon18503-21processes19:27:581
22915995613,26cyclictest0-21swapper/119:42:211
2291199564,12cyclictest0-21swapper/021:22:360
22911995632,9cyclictest31154-21ssh21:42:500
22911995632,8cyclictest4696-21ssh22:40:490
2291199563,11cyclictest0-21swapper/021:50:480
2291199563,11cyclictest0-21swapper/021:50:480
22911995621,20cyclictest0-21swapper/019:18:410
22911995611,26cyclictest0-21swapper/023:32:130
2291599554,34cyclictest0-21swapper/121:43:561
2291599554,11cyclictest9931-21tune2fs21:12:361
2291599554,11cyclictest9931-21tune2fs21:12:361
2291599554,10cyclictest15631-21sendmail_mailqu20:32:501
2291599554,10cyclictest15631-21sendmail_mailqu20:32:501
22915995515,33cyclictest0-21swapper/123:17:311
2291199554,11cyclictest0-21swapper/021:57:300
22911995532,8cyclictest24701-21ssh20:47:340
2291599544,44cyclictest0-21swapper/123:30:531
2291599544,44cyclictest0-21swapper/123:12:151
2291599544,34cyclictest0-21swapper/122:48:221
2291599544,34cyclictest0-21swapper/120:57:571
2291599544,23cyclictest0-21swapper/122:17:301
22915995424,12cyclictest1215-21cpuspeed_turbos20:02:341
22911995434,7cyclictest21591-21ssh23:05:590
22911995431,9cyclictest24075-21sh20:47:190
2291199543,13cyclictest0-21swapper/019:37:340
22911995428,9cyclictest29663-21ssh22:28:440
22911995428,9cyclictest29663-21ssh22:28:440
22911995423,23cyclictest0-21swapper/023:47:290
255632533,42sleep10-21swapper/118:37:391
25172532,43sleep00-21swapper/018:57:080
2291599539,22cyclictest15353-21unixbench_multi23:42:431
2291599536,29cyclictest0-21swapper/123:02:431
2291599535,29cyclictest0-21swapper/122:14:401
2291599533,22cyclictest8478-21munin-run22:47:141
22915995321,12cyclictest0-21swapper/120:48:571
2291599532,46cyclictest0-21swapper/120:46:571
22911995333,8cyclictest13925-21diskmemload21:14:470
22911995333,8cyclictest13925-21diskmemload21:14:470
22911995332,8cyclictest1837-21ssh21:01:320
22911995330,9cyclictest1124-21snmpd21:09:060
22911995330,9cyclictest1124-21snmpd21:09:060
2291199533,24cyclictest0-21swapper/022:17:300
2291199533,21cyclictest0-21swapper/020:17:310
22911995328,8cyclictest11842-21munin-run22:52:130
43712523,43sleep10-21swapper/122:39:401
2291599525,27cyclictest0-21swapper/122:57:431
2291599524,32cyclictest0-21swapper/121:26:201
2291599524,26cyclictest0-21swapper/119:47:221
2291599524,10cyclictest28843-21munin-node22:27:421
2291599524,10cyclictest28843-21munin-node22:27:421
22915995238,9cyclictest10544-21cut19:12:391
22915995222,9cyclictest21124-21unixbench_multi21:27:501
22915995222,24cyclictest0-21swapper/122:32:391
2291199524,41cyclictest0-21swapper/023:12:260
22911995229,8cyclictest13925-21diskmemload20:52:490
22911995220,13cyclictest0-21swapper/019:12:230
69832513,11sleep10-21swapper/119:03:021
48832514,13sleep10-21swapper/121:04:551
327332513,10sleep10-21swapper/119:58:041
2291599515,27cyclictest0-21swapper/118:43:351
2291599514,8cyclictest11260-21irqstats23:37:351
2291599514,11cyclictest0-21swapper/122:52:431
2291599513,12cyclictest0-21swapper/120:54:111
22915995122,12cyclictest0-21swapper/123:10:571
22915995120,14cyclictest14347-21cpuspeed_turbos22:07:311
22915995119,14cyclictest0-21swapper/120:22:381
2291199518,26cyclictest0-21swapper/020:36:030
2291199518,26cyclictest0-21swapper/020:36:030
2291199513,42cyclictest0-21swapper/022:59:410
22911995128,8cyclictest3620-21ssh21:02:430
22911995128,10cyclictest1124-21snmpd18:58:370
22911995123,21cyclictest28824-21cpuspeed_turbos19:52:360
22911995123,21cyclictest28824-21cpuspeed_turbos19:52:360
22911995118,14cyclictest0-21swapper/021:28:070
320762503,42sleep10-21swapper/118:47:581
280662503,41sleep00-21swapper/021:38:160
2291599505,27cyclictest0-21swapper/119:47:441
2291599505,27cyclictest0-21swapper/119:47:441
2291599505,26cyclictest0-21swapper/121:59:161
2291599504,27cyclictest0-21swapper/121:52:301
2291599503,12cyclictest0-21swapper/118:34:551
22915995021,9cyclictest2393-21munin-node21:47:521
22915995021,9cyclictest2393-21munin-node21:47:521
22915995020,11cyclictest0-21swapper/122:22:181
22915995018,13cyclictest0-21swapper/123:54:541
2291199504,28cyclictest0-21swapper/023:22:270
2291199503,29cyclictest0-21swapper/020:12:390
72502493,38sleep10-21swapper/120:12:511
2291599495,26cyclictest0-21swapper/119:57:211
2291599495,26cyclictest0-21swapper/119:57:211
2291599494,27cyclictest0-21swapper/120:08:491
2291599494,27cyclictest0-21swapper/119:22:441
22915994914,14cyclictest0-21swapper/118:53:371
22911994923,11cyclictest0-21swapper/020:22:300
213402492,42sleep00-21swapper/019:33:240
279852483,10sleep00-21swapper/019:48:230
279852483,10sleep00-21swapper/019:48:230
2291599485,25cyclictest0-21swapper/118:57:401
2291599483,24cyclictest9690-21yum-updatesd-he19:12:231
22915994819,12cyclictest0-21swapper/119:17:341
2291199483,39cyclictest0-21swapper/019:22:240
22911994819,12cyclictest0-21swapper/020:12:200
191882482,40sleep00-21swapper/019:31:270
137832483,38sleep10-21swapper/120:30:411
88852473,10sleep10-21swapper/120:19:121
2291199476,27cyclictest0-21swapper/019:42:480
22911994625,9cyclictest965-21telnet20:02:320
226912454,6sleep00-21swapper/018:29:570
226912454,6sleep00-21swapper/018:29:570
119672452,38sleep00-21swapper/019:15:470
4902442,37sleep00-21swapper/020:00:570
22911994429,9cyclictest12970-21strings20:27:430
2291599373,11cyclictest0-21swapper/118:32:241
2291599373,11cyclictest0-21swapper/118:32:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional