You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-31 - 10:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Tue Mar 31, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991120,5rtkit-daemon2484-21rtkit-daemon22:38:580
345421030,5sleep13451-21cut20:23:581
433699995,13cyclictest0-21swapper/019:34:030
433699994,14cyclictest0-21swapper/020:19:000
248599980,4rtkit-daemon31968-21ssh21:06:392
4339999745,11cyclictest6524-21grep18:39:012
433699974,27cyclictest0-21swapper/020:13:550
4336999715,14cyclictest0-21swapper/020:00:160
433699964,15cyclictest0-21swapper/020:41:170
433699957,20cyclictest0-21swapper/022:33:570
433699954,81cyclictest0-21swapper/022:29:050
433699954,22cyclictest0-21swapper/021:56:260
4339999414,28cyclictest0-21swapper/220:50:542
433699944,27cyclictest0-21swapper/019:33:400
433699944,26cyclictest0-21swapper/022:43:460
4336999410,69cyclictest0-21swapper/022:49:020
4336999410,69cyclictest0-21swapper/022:49:020
434099934,81cyclictest0-21swapper/322:23:463
433699935,78cyclictest0-21swapper/022:18:550
433699935,24cyclictest0-21swapper/020:49:040
433699934,66cyclictest0-21swapper/017:53:430
433699934,25cyclictest0-21swapper/021:49:590
4336999322,54cyclictest0-21swapper/019:53:590
434099924,80cyclictest0-21swapper/320:02:163
433699925,78cyclictest0-21swapper/020:47:300
433699924,29cyclictest0-21swapper/019:44:030
433699923,72cyclictest0-21swapper/022:13:170
433699923,72cyclictest0-21swapper/022:13:170
434099912,48cyclictest0-21swapper/320:08:523
433699914,62cyclictest0-21swapper/021:43:550
4336999132,51cyclictest0-21swapper/022:07:260
4336999132,51cyclictest0-21swapper/022:07:260
4336999119,13cyclictest0-21swapper/022:23:500
433699905,76cyclictest0-21swapper/019:09:100
433699904,77cyclictest23049-21grep20:53:520
433699904,77cyclictest0-21swapper/021:03:510
433699904,28cyclictest0-21swapper/018:44:010
433699904,28cyclictest0-21swapper/018:44:010
433699904,25cyclictest0-21swapper/019:42:060
433699903,24cyclictest0-21swapper/021:09:510
434099895,76cyclictest0-21swapper/319:51:463
434099894,78cyclictest0-21swapper/322:18:563
433699894,77cyclictest0-21swapper/021:26:150
433699894,77cyclictest0-21swapper/021:26:150
433699894,76cyclictest0-21swapper/020:58:570
433699894,26cyclictest7467-21gltestperf22:53:530
433699893,79cyclictest0-21swapper/020:29:250
433699893,30cyclictest5483-21ssh20:28:040
434099885,61cyclictest0-21swapper/321:56:553
434099884,66cyclictest0-21swapper/322:49:233
434099884,66cyclictest0-21swapper/322:49:233
434099883,78cyclictest22556-21df22:28:483
433699885,74cyclictest0-21swapper/018:39:160
433699884,28cyclictest0-21swapper/020:10:590
433699884,28cyclictest0-21swapper/019:23:410
433699884,25cyclictest23988-21ssh21:43:360
248599880,4rtkit-daemon2484-21rtkit-daemon20:33:263
434099875,64cyclictest0-21swapper/322:56:093
434099874,76cyclictest0-21swapper/320:25:103
434099874,63cyclictest0-21swapper/318:29:013
434099874,63cyclictest0-21swapper/318:10:453
4340998710,51cyclictest18777-21grep19:04:043
433699878,23cyclictest8129-21grep21:18:550
433699875,64cyclictest0-21swapper/019:53:090
433699874,26cyclictest0-21swapper/022:03:210
4336998725,54cyclictest293601diskmemload20:04:030
4336998725,54cyclictest293601diskmemload20:04:030
4336998723,56cyclictest0-21swapper/017:34:110
434099864,61cyclictest0-21swapper/322:35:323
434099863,64cyclictest0-21swapper/319:45:233
434099863,62cyclictest0-21swapper/319:29:113
433699864,73cyclictest0-21swapper/022:17:570
433699864,65cyclictest0-21swapper/018:59:040
433699864,25cyclictest14057-21aten_r1power_en21:28:480
433699864,24cyclictest0-21swapper/021:17:200
4336998628,51cyclictest0-21swapper/021:34:060
434099855,62cyclictest0-21swapper/320:22:553
434099854,74cyclictest0-21swapper/321:06:483
434099853,62cyclictest12073-21aten_r1power_fr22:13:483
4336998526,51cyclictest0-21swapper/018:54:020
434099845,64cyclictest0-21swapper/319:55:503
434099844,64cyclictest0-21swapper/321:23:213
434099844,63cyclictest0-21swapper/319:39:243
434099844,61cyclictest0-21swapper/321:48:483
434099843,74cyclictest16768-21ssh21:32:273
434099843,73cyclictest0-21swapper/320:14:013
434099843,66cyclictest0-21swapper/322:44:003
433699844,73cyclictest0-21swapper/018:09:060
433699844,71cyclictest0-21swapper/020:34:260
433699844,21cyclictest0-21swapper/019:24:000
433699844,21cyclictest0-21swapper/019:24:000
433699843,24cyclictest0-21swapper/018:19:020
287062840,4sleep229-21ksoftirqd/221:49:012
248599840,8rtkit-daemon0-21swapper/122:39:063
434099834,71cyclictest1419-21runrttasks20:04:133
434099834,71cyclictest1419-21runrttasks20:04:133
434099834,71cyclictest1149-21perl21:08:553
434099834,63cyclictest0-21swapper/320:55:203
434099834,61cyclictest0-21swapper/322:13:123
434099834,61cyclictest0-21swapper/322:13:123
434099833,73cyclictest0-21swapper/320:38:513
434099833,65cyclictest0-21swapper/320:48:363
4340998310,49cyclictest121850irq/46-eth021:44:013
433699834,25cyclictest0-21swapper/018:33:560
434099829,58cyclictest0-21swapper/320:37:583
434099824,59cyclictest0-21swapper/320:52:343
434099824,57cyclictest0-21swapper/320:59:093
4338998228,47cyclictest1502-21ssh22:44:061
433699825,28cyclictest0-21swapper/017:59:570
433699825,28cyclictest0-21swapper/017:59:570
433699824,70cyclictest0-21swapper/019:14:030
433699824,69cyclictest0-21swapper/018:24:150
433699824,69cyclictest0-21swapper/018:17:500
4336998230,46cyclictest22088-21gltestperf18:04:030
4336998230,45cyclictest12027-21cpuspeed_turbos17:43:580
4336998217,14cyclictest0-21swapper/017:29:090
434099814,61cyclictest0-21swapper/321:26:143
434099814,61cyclictest0-21swapper/321:26:143
434099813,70cyclictest0-21swapper/319:23:263
434099813,62cyclictest0-21swapper/321:13:553
433699814,68cyclictest0-21swapper/018:29:050
433699814,28cyclictest16848-21grep17:53:570
434099804,69cyclictest0-21swapper/321:33:573
434099804,68cyclictest0-21swapper/318:01:543
434099804,68cyclictest0-21swapper/318:01:543
434099804,66cyclictest9228-21ls18:44:073
434099804,66cyclictest9228-21ls18:44:073
434099804,60cyclictest0-21swapper/317:54:103
434099803,69cyclictest0-21swapper/318:41:593
434099803,57cyclictest0-21swapper/322:06:503
434099803,57cyclictest0-21swapper/322:06:503
434099803,52cyclictest0-21swapper/318:04:163
4340998012,52cyclictest3312-21munin-node18:34:063
4340998011,46cyclictest0-21swapper/321:40:333
4338998031,42cyclictest8393-21unixbench_multi22:54:071
433699805,15cyclictest0-21swapper/017:42:060
433699804,67cyclictest0-21swapper/019:07:350
434099794,66cyclictest0-21swapper/319:12:573
434099794,59cyclictest0-21swapper/319:24:023
434099794,59cyclictest0-21swapper/319:24:023
434099794,57cyclictest0-21swapper/319:33:523
434099794,47cyclictest0-21swapper/322:00:193
4338997925,47cyclictest13443-21runrttasks21:27:381
4338997925,47cyclictest13443-21runrttasks21:27:381
434099785,65cyclictest7612-21fschecks_count17:34:023
434099784,53cyclictest28962-21df_abs18:18:583
248599780,5rtkit-daemon2484-21rtkit-daemon22:50:432
248599780,5rtkit-daemon2484-21rtkit-daemon22:50:432
434099773,67cyclictest14376-21cpuspeed_turbos17:48:583
434099773,65cyclictest0-21swapper/318:50:293
433999779,9cyclictest121850irq/46-eth020:43:382
126512770,3sleep2281ktimersoftd/217:44:052
434099763,54cyclictest31670-21gltestperf18:24:023
4336997621,10cyclictest12219-21head18:49:150
434099755,61cyclictest23544-21memory19:14:053
434099755,54cyclictest15253-21munin-node18:59:083
4340997536,32cyclictest10183-21gltestperf17:39:033
4339997517,12cyclictest0-21swapper/222:34:482
4338997522,46cyclictest0-21swapper/121:08:541
4338997522,46cyclictest0-21swapper/120:12:451
434099743,65cyclictest0-21swapper/318:14:183
434099743,64cyclictest0-21swapper/317:44:073
4338997429,39cyclictest1419-21runrttasks18:14:031
4338997426,39cyclictest6812-21gltestperf20:29:001
4338997420,46cyclictest0-21swapper/122:26:071
4338997419,48cyclictest0-21swapper/120:53:571
4338997416,45cyclictest121850irq/46-eth021:33:171
4338997329,38cyclictest18697-21runrttasks20:47:161
4338997321,45cyclictest0-21swapper/120:39:101
4338997321,44cyclictest0-21swapper/120:33:491
434099724,60cyclictest0-21swapper/318:53:553
4338997226,28cyclictest1287-21snmpd19:34:161
4338997222,18cyclictest0-21swapper/120:08:121
4338997222,18cyclictest0-21swapper/120:08:121
4338997221,43cyclictest0-21swapper/121:14:051
4338997221,15cyclictest0-21swapper/122:07:331
4338997221,15cyclictest0-21swapper/122:07:331
4338997218,47cyclictest0-21swapper/117:59:021
4338997218,47cyclictest0-21swapper/117:59:021
434099714,44cyclictest5126-21df_inode17:29:003
4338997126,38cyclictest17217-21munin-node22:19:081
4338997125,39cyclictest26721-21grep20:58:541
4338997121,42cyclictest0-21swapper/119:39:031
4338997027,27cyclictest28483-21cpuspeed_turbos20:13:541
4338997026,37cyclictest16483-21runrttasks17:53:471
4338997025,37cyclictest24102-21munin-node21:44:031
4338997013,50cyclictest0-21swapper/118:09:061
4338996926,37cyclictest8614-21proc_pri21:19:031
4338996926,36cyclictest12557-21grep22:13:521
4338996926,27cyclictest22838-21sort18:04:161
4338996922,40cyclictest1811-21ssh20:22:221
4338996920,29cyclictest0-21swapper/118:38:431
4338996920,16cyclictest0-21swapper/122:29:471
4338996825,36cyclictest10944-21crond19:48:391
4338996825,35cyclictest6311-21runrttasks22:53:281
4338996825,35cyclictest6311-21runrttasks22:53:281
4338996825,35cyclictest19432-21aten_r1power_fr20:48:491
4338996823,29cyclictest23493-21ssh21:42:231
4338996822,39cyclictest0-21swapper/118:19:021
4338996820,40cyclictest0-21swapper/122:34:001
4338996819,41cyclictest0-21swapper/119:59:111
4338996818,44cyclictest0-21swapper/121:59:231
4338996818,43cyclictest0-21swapper/121:33:541
4338996727,32cyclictest8728-21aten_r1power_po22:08:451
4338996727,32cyclictest8728-21aten_r1power_po22:08:451
4338996720,41cyclictest0-21swapper/121:53:481
4338996719,41cyclictest0-21swapper/121:03:471
4338996627,33cyclictest11817-21munin-node18:49:091
4338996626,33cyclictest1419-21runrttasks19:33:181
4338996624,26cyclictest13596-21fschecks_time18:54:001
4338996623,37cyclictest29709-21expr22:38:531
4338996619,40cyclictest0-21swapper/119:51:101
4338996617,41cyclictest8835-21chrt17:35:291
248599660,8rtkit-daemon0-21swapper/220:24:492
248599660,6rtkit-daemon2484-21rtkit-daemon20:20:042
248599660,5rtkit-daemon2484-21rtkit-daemon22:14:292
4338996525,33cyclictest219071sshd19:10:071
4338996524,34cyclictest150911rm19:53:541
4338996523,35cyclictest27655-21cpu21:48:481
4338996518,41cyclictest0-21swapper/119:08:411
433699653,11cyclictest0-21swapper/017:28:450
298892657,9sleep229899-21irqstats22:38:562
434099644,54cyclictest0-21swapper/317:28:453
4338996427,30cyclictest16122-21runrttasks17:52:011
4338996427,18cyclictest121850irq/46-eth017:29:081
4338996419,38cyclictest0-21swapper/118:23:551
4338996418,40cyclictest0-21swapper/117:43:571
248599640,6rtkit-daemon2484-21rtkit-daemon20:47:032
87912634,50sleep20-21swapper/220:32:552
4338996318,39cyclictest0-21swapper/118:47:071
4338996318,39cyclictest0-21swapper/118:47:071
248599630,8rtkit-daemon0-21swapper/222:04:222
248599630,8rtkit-daemon0-21swapper/222:04:222
248599630,6rtkit-daemon2484-21rtkit-daemon20:00:202
4338996219,37cyclictest6974-21ntp_offset18:39:081
4338996218,36cyclictest0-21swapper/119:28:411
4338996218,36cyclictest0-21swapper/119:28:411
248599620,6rtkit-daemon0-21swapper/221:02:172
4338996122,33cyclictest0-21swapper/117:38:581
4338996118,36cyclictest1368-21munin-node18:28:581
248599610,7rtkit-daemon0-21swapper/219:58:352
433999605,11cyclictest4265-21rm22:01:022
433999604,13cyclictest0-21swapper/222:53:492
4338996015,39cyclictest0-21swapper/119:13:541
273832603,49sleep20-21swapper/218:14:132
248599600,2rtkit-daemon0-21swapper/220:33:562
433999594,48cyclictest0-21swapper/221:22:102
248599590,6rtkit-daemon0-21swapper/222:22:072
239102585,45sleep20-21swapper/218:08:572
4338995725,12cyclictest7250irq/45-ahci19:19:131
4338995716,23cyclictest0-21swapper/118:59:031
433999564,45cyclictest0-21swapper/221:23:502
433999564,45cyclictest0-21swapper/221:23:502
433999564,44cyclictest0-21swapper/220:08:592
4339995616,21cyclictest0-21swapper/219:44:052
433999556,42cyclictest0-21swapper/220:18:392
4339995522,13cyclictest1419-21runrttasks21:33:182
240902553,44sleep224094-21ssh21:43:452
200342556,41sleep20-21swapper/221:37:042
433999545,30cyclictest0-21swapper/221:12:422
433999545,30cyclictest0-21swapper/219:29:042
433999545,21cyclictest0-21swapper/218:55:052
433999544,44cyclictest0-21swapper/220:04:032
433999544,44cyclictest0-21swapper/220:04:032
433999544,43cyclictest0-21swapper/222:29:032
4339995436,11cyclictest28785-21grep18:18:562
4339995420,14cyclictest0-21swapper/221:38:562
433999535,42cyclictest0-21swapper/222:44:022
433999535,14cyclictest0-21swapper/221:53:532
433999534,28cyclictest0-21swapper/219:41:232
433999534,25cyclictest0-21swapper/218:07:082
4339995315,11cyclictest11212-21munin-node19:49:062
433999525,28cyclictest0-21swapper/219:13:532
433999525,14cyclictest0-21swapper/222:24:122
433999524,30cyclictest0-21swapper/219:24:142
433999524,30cyclictest0-21swapper/219:24:142
433999524,29cyclictest0-21swapper/218:29:002
4339995222,13cyclictest0-21swapper/217:34:112
4339995221,13cyclictest0-21swapper/217:29:042
93972513,41sleep29505-21tail22:08:532
93972513,41sleep29505-21tail22:08:532
433999514,29cyclictest0-21swapper/218:48:552
433999514,29cyclictest0-21swapper/217:39:122
433999514,28cyclictest0-21swapper/219:08:562
433999514,28cyclictest0-21swapper/217:49:092
433999514,27cyclictest1287-21snmpd18:24:052
4339995132,13cyclictest0-21swapper/220:55:512
4339995120,13cyclictest0-21swapper/221:14:442
4339995120,13cyclictest0-21swapper/217:59:022
4339995120,13cyclictest0-21swapper/217:59:022
4339995119,14cyclictest0-21swapper/219:33:552
433999506,35cyclictest1419-21runrttasks18:33:572
433999505,27cyclictest0-21swapper/218:59:082
433999504,28cyclictest0-21swapper/219:03:582
4339995019,13cyclictest0-21swapper/218:44:122
4339995019,13cyclictest0-21swapper/218:44:122
4338995026,18cyclictest0-21swapper/117:28:451
433999494,27cyclictest0-21swapper/219:18:512
4339994817,14cyclictest0-21swapper/217:54:122
42912433,33sleep20-21swapper/217:28:382
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional