You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-04 - 15:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Tue Aug 04, 2026 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25454991333,104cyclictest0-21swapper/010:00:320
25454991283,102cyclictest11622-21date10:00:300
25454991283,102cyclictest11622-21date10:00:300
2765321100,7sleep027655-21ntp_kernel_err11:40:540
2172221080,2sleep10-21swapper/111:33:421
25454991072,94cyclictest0-21swapper/010:55:290
115021050,3sleep22545699cyclictest12:29:562
337321030,5sleep13368-21ssh11:10:461
25454991036,79cyclictest15212-21ntpq12:05:530
25454991022,80cyclictest8179-21grep11:15:580
25454991022,80cyclictest18351-21wc08:20:300
25454991022,78cyclictest20019-21cron09:30:280
25454991021,6cyclictest19791-21apt-config10:10:300
254579910013,36cyclictest11498-21latency_hist10:00:303
254579910013,36cyclictest11498-21latency_hist10:00:303
25454991002,86cyclictest3329-21tune2fs11:10:450
25454991002,86cyclictest2076-21latency_hist07:35:290
2545499991,5cyclictest24161-21aten_rbpower_po10:15:450
112082990,2sleep30-21swapper/311:20:473
2545499981,5cyclictest3830-21/usr/sbin/munin09:50:520
2545499972,76cyclictest0-21swapper/009:35:480
2545499942,75cyclictest20863-21cat08:25:510
2545499941,4cyclictest10429-21apt-get12:00:370
2545499934,72cyclictest0-21swapper/011:55:290
2545499931,5cyclictest993-21tune2fs09:00:470
308652920,6sleep12545599cyclictest09:43:191
2545499912,75cyclictest2202-21latency_hist11:50:300
2545499911,6cyclictest6896-21grep07:45:590
2545499902,71cyclictest29162-21timerwakeupswit10:20:570
2545499882,72cyclictest0-21swapper/010:57:420
2545499874,67cyclictest0-21swapper/010:49:510
2545499861,3cyclictest0-21swapper/009:49:350
2545499853,78cyclictest0-21swapper/009:25:290
2545499852,72cyclictest0-21swapper/009:43:540
2545499852,71cyclictest0-21swapper/009:19:400
2545499851,5cyclictest19548-21apt-get10:10:300
2545499851,4cyclictest2672-21modprobe11:10:290
2545499838,29cyclictest0-21swapper/009:30:420
2545499832,69cyclictest0-21swapper/012:35:010
2545499831,5cyclictest7766-21ssh12:37:180
2545499831,5cyclictest7766-21ssh12:37:180
2545499831,3cyclictest0-21swapper/007:40:450
2545499826,64cyclictest25450-21cyclictest10:44:410
2545499822,73cyclictest0-21swapper/007:10:300
2545499822,4cyclictest0-21swapper/011:25:540
2545499821,5cyclictest6669-21df11:55:460
2545599817,55cyclictest11532-21ls10:00:291
2545599817,55cyclictest11532-21ls10:00:291
2545499812,69cyclictest12176-21grep11:21:010
2545499811,6cyclictest18218-21apt-get08:20:330
2545499802,42cyclictest3628-21grep10:30:420
2545499801,5cyclictest0-21swapper/012:24:120
2545499801,5cyclictest0-21swapper/012:13:420
2545499792,64cyclictest0-21swapper/009:14:190
2545499792,62cyclictest0-21swapper/011:37:030
2545499791,5cyclictest3880-21grep07:40:290
2545499791,5cyclictest23805-21ssh12:16:210
2545499791,57cyclictest10630-21ssh10:39:290
2545499782,60cyclictest0-21swapper/008:15:300
2545499782,60cyclictest0-21swapper/008:01:520
2545499781,5cyclictest32012-21ssh12:26:490
25455997723,23cyclictest14590-21ssh11:25:291
2545499761,4cyclictest29761-21ssh11:02:540
2545699753,41cyclictest11515-21ssh10:00:292
2545699753,41cyclictest11515-21ssh10:00:292
2545499752,4cyclictest0-21swapper/007:51:170
2545499741,5cyclictest0-21swapper/010:26:130
2545499741,49cyclictest19376-21ssh11:30:470
243432740,5sleep10-21swapper/107:05:541
2545499731,5cyclictest0-21swapper/008:47:180
2545499728,41cyclictest31236-21latency_hist08:55:300
2545499728,41cyclictest31236-21latency_hist08:55:300
25456997115,41cyclictest7950irq/56-dwc_otg_10:00:312
2545499712,55cyclictest0-21swapper/007:59:380
25455997037,9cyclictest727-21runrttasks12:00:401
2545499701,4cyclictest31522-21diskstats08:55:460
252812700,7sleep325284-21latency_hist07:10:293
2545699697,42cyclictest8050irq/56-dwc_otg_09:20:422
2545499693,5cyclictest30671-21munin-run07:25:290
2545499693,5cyclictest30671-21munin-run07:25:290
2545499691,5cyclictest4118-21ssh09:10:290
2545499681,5cyclictest0-21swapper/008:31:070
2545499681,5cyclictest0-21swapper/008:09:540
25455996720,25cyclictest32167-21ls11:05:521
25455996616,28cyclictest13040-21apt-get08:05:391
2545499661,6cyclictest8050irq/56-dwc_otg_07:30:280
2545499651,4cyclictest25769-21cut08:40:300
2545499651,4cyclictest25769-21cut08:40:300
2545599647,38cyclictest0-21swapper/108:25:441
25455996315,15cyclictest15598-21basename10:05:291
25455996311,28cyclictest8050irq/56-dwc_otg_09:25:301
2545499631,5cyclictest27373-21taskset08:44:340
2545499621,5cyclictest28814-21seq07:20:040
25455996119,23cyclictest7790-21ssh12:37:201
25455996119,23cyclictest7790-21ssh12:37:201
25455996038,9cyclictest7850irq/56-dwc_otg09:36:081
25455996017,24cyclictest9431-21ssh10:37:061
2545599595,16cyclictest0-21swapper/111:15:401
25455995912,28cyclictest19753-21sh12:11:061
2545599588,36cyclictest0-21swapper/108:20:351
25455995831,21cyclictest0-21swapper/107:10:301
25455995817,24cyclictest19919-21ssh10:10:361
25455995814,26cyclictest19009-21rm10:50:131
25455995813,5cyclictest7850irq/56-dwc_otg10:30:401
2545699578,34cyclictest0-21swapper/212:30:442
2545599578,31cyclictest0-21swapper/110:20:421
25455995716,23cyclictest2139-21latency_hist07:35:301
25455995710,21cyclictest0-21swapper/109:00:411
2545799568,29cyclictest10433-21ssh12:00:373
2545599563,40cyclictest6145-21cat11:55:291
25455995616,21cyclictest2521-21ssh10:29:131
25455995614,27cyclictest24039-21/usr/sbin/munin10:16:011
25455995612,29cyclictest0-21swapper/112:30:441
25455995515,28cyclictest25888-21rm10:58:051
25455995514,25cyclictest8692-21ssh11:57:491
25455995513,23cyclictest17230-21ssh12:08:541
2545799549,29cyclictest0-21swapper/308:10:433
2545799549,29cyclictest0-21swapper/307:30:373
2545799548,29cyclictest0-21swapper/309:10:363
2545699548,29cyclictest0-21swapper/211:45:412
2545699548,29cyclictest0-21swapper/211:25:352
25455995417,21cyclictest22981-21ssh09:33:281
25455995416,13cyclictest29754-21ssh11:02:531
25455995415,23cyclictest3014-21ssh09:49:341
25455995415,21cyclictest16515-21ssh11:26:201
25455995412,26cyclictest26279-21ssh11:39:561
2545799534,14cyclictest11789-21apt-key10:00:313
25456995321,13cyclictest4033-21apt-get07:40:412
25456995314,18cyclictest301ktimersoftd/209:51:552
25455995316,22cyclictest23984-21ssh12:16:421
2545699529,26cyclictest8557-21ssh12:38:522
2545699529,26cyclictest8557-21ssh12:38:522
2545699528,33cyclictest0-21swapper/212:00:362
2545699528,27cyclictest0-21swapper/208:20:362
2545699527,28cyclictest0-21swapper/207:35:432
2545599529,27cyclictest26302-21ssh12:20:371
2545599528,30cyclictest0-21swapper/109:05:441
248472523,13sleep00-21swapper/007:06:140
2545699518,28cyclictest0-21swapper/210:15:362
2545699517,28cyclictest7599-21ssh10:35:442
25456995123,18cyclictest301ktimersoftd/211:50:592
2545599519,9cyclictest2916-21ntpq07:35:541
25455995116,12cyclictest13534-21ssh10:42:211
25456995015,19cyclictest301ktimersoftd/211:55:422
25455995022,15cyclictest7850irq/56-dwc_otg12:27:101
25455995017,13cyclictest6131-21ssh09:11:351
25455995013,9cyclictest0-21swapper/109:52:131
2545799495,27cyclictest23982-21ssh10:15:353
2545699495,26cyclictest0-21swapper/208:25:442
25456994933,9cyclictest7850irq/56-dwc_otg10:44:442
25456994923,21cyclictest0-21swapper/207:10:302
25456994915,17cyclictest31403-21ssh11:05:352
25456994913,19cyclictest301ktimersoftd/212:21:592
2545599498,27cyclictest0-21swapper/107:55:431
25455994915,13cyclictest19992-21ssh09:30:241
25455994913,19cyclictest221ktimersoftd/111:47:331
2545699487,25cyclictest8050irq/56-dwc_otg_12:16:462
25456994815,16cyclictest301ktimersoftd/209:35:512
25456994815,14cyclictest301ktimersoftd/210:10:302
25456994814,18cyclictest301ktimersoftd/211:19:012
2545599488,25cyclictest9995-21ssh09:16:281
25455994814,13cyclictest19516-21ssh10:10:261
2545799478,26cyclictest19926-21ssh10:10:363
2545699478,24cyclictest31-21ksoftirqd/210:25:432
2545699477,25cyclictest12473-21ssh11:21:232
25456994715,23cyclictest3860-21processes11:10:532
25456994713,18cyclictest301ktimersoftd/210:33:212
25456994711,11cyclictest0-21swapper/210:59:322
25456994710,13cyclictest29726-21ssh11:02:502
2545599476,11cyclictest0-21swapper/107:25:291
2545599476,11cyclictest0-21swapper/107:25:291
2545599475,12cyclictest4369-21fschecks_time07:40:481
25455994711,22cyclictest31357-21aten_rbpower_en08:55:441
25456994614,14cyclictest301ktimersoftd/212:05:502
2545699461,29cyclictest0-21swapper/209:45:432
25456994612,18cyclictest8050irq/56-dwc_otg_10:24:012
25456994612,17cyclictest8050irq/56-dwc_otg_09:41:142
2545599467,11cyclictest0-21swapper/110:53:471
25455994612,18cyclictest29054-21ssh11:42:381
2545699451,4cyclictest8050irq/56-dwc_otg_08:40:402
25455994511,19cyclictest27195-21chrt08:42:171
123272451,39sleep312340-21awk10:40:553
2545799441,32cyclictest7641-21ls11:15:513
2545699447,26cyclictest7950irq/56-dwc_otg_07:25:592
2545699443,21cyclictest10138-21ssh09:16:442
2545599446,24cyclictest0-21swapper/107:45:441
2545799431,26cyclictest1969-21ls12:30:453
2545699438,20cyclictest0-21swapper/209:05:442
2545699438,18cyclictest0-21swapper/211:30:422
2545699436,22cyclictest26933-21ssh11:40:452
25456994324,9cyclictest7850irq/56-dwc_otg10:07:522
25456994317,15cyclictest8050irq/56-dwc_otg_07:30:402
2545599433,10cyclictest0-21swapper/108:50:421
2545599433,10cyclictest0-21swapper/108:50:421
25455994311,5cyclictest9080-21runrttasks07:54:151
2545799428,20cyclictest0-21swapper/312:35:353
2545799428,20cyclictest0-21swapper/312:35:353
2545799428,20cyclictest0-21swapper/310:50:423
2545799427,25cyclictest0-21swapper/308:15:433
25456994225,9cyclictest8050irq/56-dwc_otg_12:11:312
25456994215,7cyclictest301ktimersoftd/208:20:302
25456994211,14cyclictest22953-21ssh10:55:092
2545599427,25cyclictest0-21swapper/108:30:431
2545599427,25cyclictest0-21swapper/107:29:311
2545599422,30cyclictest0-21swapper/107:15:531
25455994218,4cyclictest7850irq/56-dwc_otg08:12:511
52512411,3sleep30-21swapper/310:31:453
2545799414,15cyclictest8050irq/56-dwc_otg_11:10:383
2545799411,24cyclictest20125-21latency_hist08:25:293
2545699418,18cyclictest0-21swapper/209:10:352
2545699416,24cyclictest7950irq/56-dwc_otg_08:30:572
2545699416,21cyclictest0-21swapper/208:05:422
2545699412,14cyclictest30818-21latency_hist07:25:302
2545699412,14cyclictest30818-21latency_hist07:25:302
25456994119,4cyclictest27333-21basename07:15:442
25456994115,6cyclictest20557-21cpuspeed09:30:442
25456994115,11cyclictest4041-21diskmemload11:37:242
25456994112,14cyclictest301ktimersoftd/210:50:122
2545599413,14cyclictest0-21swapper/108:40:301
2545599413,14cyclictest0-21swapper/108:40:301
2545799406,4cyclictest0-21swapper/311:44:023
2545799402,26cyclictest31130-21latency_hist11:05:293
2545799401,22cyclictest4246-21apt-config09:10:293
2545699409,19cyclictest6998-21users07:46:002
2545699408,23cyclictest0-21swapper/208:55:492
25456994020,8cyclictest9490-21wget07:55:442
25455994010,8cyclictest12495-21seq08:01:551
2545799398,19cyclictest0-21swapper/309:40:443
2545799398,15cyclictest8050irq/56-dwc_otg_12:00:293
2545799397,22cyclictest2495-21ssh11:50:433
2545799395,28cyclictest8050irq/56-dwc_otg_08:30:403
2545799395,23cyclictest26367-21ssh12:20:433
2545799393,6cyclictest24387-21ssh10:55:583
2545799391,25cyclictest8050irq/56-dwc_otg_09:35:293
2545799391,19cyclictest15273-21df11:25:463
2545699396,19cyclictest125-21systemd-journal08:12:512
25456993915,14cyclictest17212-21/usr/sbin/munin09:25:562
25455993913,15cyclictest18288-21apt-config08:20:291
2545799384,16cyclictest0-21swapper/312:10:293
2545799382,23cyclictest0-21swapper/311:34:443
2545799381,26cyclictest2501-21cut07:35:473
2545799381,10cyclictest2233-21wc11:50:303
2545699381,27cyclictest0-21swapper/209:05:292
25457993713,15cyclictest0-21swapper/309:26:443
25457993710,11cyclictest0-21swapper/307:10:313
25456993712,12cyclictest7950irq/56-dwc_otg_07:53:462
2545599372,11cyclictest29021-21chrt08:47:411
190772370,6sleep32545799cyclictest10:50:213
2545799367,14cyclictest8050irq/56-dwc_otg_09:15:443
2545799362,20cyclictest0-21swapper/309:05:293
2545799361,3cyclictest0-21swapper/312:28:063
2545799361,15cyclictest7652-21wget10:35:453
2545699361,12cyclictest0-21swapper/208:02:152
2545799358,5cyclictest8050irq/56-dwc_otg_07:25:593
2545799358,5cyclictest0-21swapper/311:05:373
2545799355,7cyclictest7850irq/56-dwc_otg09:35:413
2545799355,17cyclictest543-21ssh09:45:523
25457993520,8cyclictest8050irq/56-dwc_otg_10:06:013
2545699356,16cyclictest0-21swapper/208:45:412
2545699356,12cyclictest30825-21seq08:52:432
2545699356,12cyclictest30825-21seq08:52:432
2545699352,19cyclictest0-21swapper/208:39:352
2545699352,19cyclictest0-21swapper/208:39:352
253002350,6sleep32545799cyclictest11:37:593
2545799347,4cyclictest0-21swapper/312:17:193
2545799347,14cyclictest0-21swapper/308:40:433
2545799347,14cyclictest0-21swapper/308:35:423
2545799347,14cyclictest0-21swapper/308:35:423
2545799341,21cyclictest4533-21ls09:50:523
2545799341,19cyclictest29367-21ls08:50:293
2545799338,16cyclictest8050irq/56-dwc_otg_09:22:003
2545799335,5cyclictest8050irq/56-dwc_otg_12:10:583
2545799334,19cyclictest13027-21/usr/sbin/munin08:05:573
2545799334,16cyclictest8050irq/56-dwc_otg_07:25:293
2545799334,16cyclictest8050irq/56-dwc_otg_07:25:293
25457993311,13cyclictest0-21swapper/310:26:593
2545799321,5cyclictest8050irq/56-dwc_otg_10:20:403
25457993210,12cyclictest8050irq/56-dwc_otg_08:00:583
2545799315,12cyclictest7950irq/56-dwc_otg_07:15:483
2545799313,16cyclictest21468-21grep08:26:003
2545799301,19cyclictest0-21swapper/307:45:493
236452306,16sleep223698-21aten_rbpower_en07:05:432
2545799292,13cyclictest0-21swapper/308:55:443
2545799282,5cyclictest518-21rs:main3
25457992811,10cyclictest0-21swapper/307:40:513
2545799281,10cyclictest30104-21ls08:50:503
2545799281,10cyclictest30104-21ls08:50:503
2545799263,5cyclictest8050irq/56-dwc_otg_07:52:313
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional