You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-12 - 14:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat Sep 12, 2026 00:44:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14316212011,70sleep114372-21switchtime19:05:071
14316212011,70sleep114372-21switchtime19:05:071
15106991173,45cyclictest21658-21ssh22:54:400
151069911228,24cyclictest0-21swapper/022:05:290
151069911223,31cyclictest21893-21modprobe19:29:240
14178211213,72sleep214210-21ps19:05:042
14178211213,72sleep214210-21ps19:05:042
15106991117,31cyclictest4175-21/usr/sbin/munin23:19:390
151069911142,61cyclictest0-21swapper/021:05:470
151069910836,8cyclictest0-21swapper/023:54:380
151069910753,48cyclictest15301-21latency_hist22:44:260
151069910753,48cyclictest15301-21latency_hist22:44:260
151069910739,10cyclictest0-21swapper/022:19:280
151069910736,11cyclictest0-21swapper/020:59:590
151069910734,10cyclictest0-21swapper/000:14:230
15106991073,34cyclictest6276-21/usr/sbin/munin21:34:590
151069910545,53cyclictest0-21swapper/020:24:510
151069910545,53cyclictest0-21swapper/020:24:510
15106991054,27cyclictest30715-21sshd00:02:380
15106991053,34cyclictest3131-21fschecks_time20:09:460
15106991044,41cyclictest652-21fschecks_time22:19:470
15106991044,38cyclictest32550-21taskset21:24:570
15106991043,38cyclictest17318-21apt-get19:14:380
15106991043,35cyclictest14904-21/usr/sbin/munin00:29:550
15106991043,35cyclictest11136-21latency_hist00:24:270
15106991043,34cyclictest18994-21latency_hist23:44:260
15106991043,34cyclictest18994-21latency_hist23:44:260
151069910431,10cyclictest0-21swapper/023:04:570
151069910427,12cyclictest0-21swapper/021:39:400
15106991042,37cyclictest6801-21cut22:29:490
15106991034,44cyclictest14155-21ls23:34:590
15106991034,34cyclictest31951-21latency_hist19:59:270
15106991034,34cyclictest31951-21latency_hist19:59:270
15106991033,36cyclictest343-21runrttasks22:15:110
15106991033,36cyclictest1827-21diskmemload23:14:560
15106991033,36cyclictest1827-21diskmemload23:14:560
15106991033,36cyclictest17716-21latency00:34:500
15106991033,36cyclictest17716-21latency00:34:500
15106991033,34cyclictest19241-21runrttasks23:44:390
15106991024,39cyclictest343-21runrttasks22:09:550
15106991024,36cyclictest27324-21idleruntime-cro23:04:240
151069910236,9cyclictest0-21swapper/021:19:560
15106991023,41cyclictest15493-21fschecks_count19:09:460
15106991023,41cyclictest15493-21fschecks_count19:09:460
15106991023,37cyclictest16923-21mailstats22:46:250
15106991023,33cyclictest2773-21cat20:09:270
151069910228,11cyclictest0-21swapper/023:30:210
151069910224,17cyclictest0-21swapper/020:39:490
151069910224,17cyclictest0-21swapper/020:39:490
15106991022,36cyclictest26619-21mailstats21:14:590
15106991022,36cyclictest26619-21mailstats21:14:590
15106991014,34cyclictest16057-21/usr/sbin/munin20:49:490
15106991014,33cyclictest12082-21timerwakeupswit20:35:010
15106991014,33cyclictest12082-21timerwakeupswit20:35:010
15106991014,32cyclictest18935-21fschecks_time22:49:450
15106991013,37cyclictest4110-21mailstats22:24:580
15106991013,37cyclictest4110-21mailstats22:24:580
15106991013,36cyclictest22788-21sendmail_mailqu19:29:570
15106991013,35cyclictest16871-21munin-node00:24:340
15106991013,35cyclictest16871-21munin-node00:24:340
15106991013,34cyclictest32343-21taskset19:59:460
15106991012,36cyclictest27251-21fschecks_time19:44:460
15106991005,33cyclictest31885-21ssh00:04:440
15106991005,33cyclictest31885-21ssh00:04:440
15106991003,38cyclictest19132-21fschecks_count19:19:470
15106991003,36cyclictest343-21runrttasks19:35:090
15106991003,36cyclictest343-21runrttasks19:35:090
15106991003,34cyclictest6321-21fschecks_count20:19:460
15106991003,34cyclictest22175-21/usr/sbin/munin23:49:490
15106991002,34cyclictest4735-21fschecks_time20:14:450
15106991002,34cyclictest4735-21fschecks_time20:14:450
151069910013,30cyclictest25769-21tr19:39:490
151069910013,30cyclictest25769-21tr19:39:490
1510699994,33cyclictest29513-21find19:50:280
1510699993,34cyclictest343-21runrttasks22:38:400
1510699993,34cyclictest343-21runrttasks22:38:400
1510699993,26cyclictest20348-21readlink21:59:240
1510699992,36cyclictest15313-21find21:49:570
1510699992,36cyclictest15313-21find21:49:570
15106999910,21cyclictest0-21swapper/021:34:240
15106999910,21cyclictest0-21swapper/021:34:240
15123999826,31cyclictest19759-21runrttasks20:59:492
1510699984,33cyclictest8107-21latency_hist00:19:270
1510699984,31cyclictest19025-21/usr/sbin/munin20:59:250
1510699983,38cyclictest14443-21/usr/sbin/munin20:44:510
1510699983,36cyclictest23534-21sendmail_mailqu21:09:590
1510699983,36cyclictest23534-21sendmail_mailqu21:09:590
1510699983,35cyclictest12053-21latency21:44:510
1510699973,36cyclictest343-21runrttasks23:11:080
1510699973,34cyclictest20763-21sort21:59:420
1510699954,33cyclictest9590-21/usr/sbin/munin20:31:320
1511799936,66cyclictest25461-21ssh23:54:391
1510699933,36cyclictest7231-21cpu23:24:400
1510699933,36cyclictest7231-21cpu23:24:400
15117999269,17cyclictest326-21systemd-logind21:19:251
15117999269,17cyclictest326-21systemd-logind21:19:251
1510699923,33cyclictest15180-21latency_hist19:09:290
1510699923,33cyclictest15180-21latency_hist19:09:290
15123999027,25cyclictest14084-21seq20:43:092
15123999027,25cyclictest14084-21seq20:43:092
15123998726,23cyclictest8111-21seq21:39:102
15123998725,27cyclictest4158-21seq20:13:572
15123998669,11cyclictest343-21runrttasks23:39:512
15123998669,11cyclictest343-21runrttasks23:39:512
15123998626,27cyclictest16304-21seq19:10:312
15123998626,27cyclictest16304-21seq19:10:312
15123998529,23cyclictest28684-21runrttasks23:59:372
15123998527,19cyclictest24215-21seq23:52:332
15123998426,26cyclictest19808-21seq22:50:122
15123998326,26cyclictest23317-21seq19:32:092
1513099822,31cyclictest24302-21chrt22:59:233
15123998233,37cyclictest0-21swapper/221:24:392
15123998228,23cyclictest8966-21seq20:28:222
15123998228,23cyclictest8966-21seq20:28:222
15123998224,20cyclictest30901-21seq21:22:322
15117998263,12cyclictest24278-21cron22:59:231
1513099813,38cyclictest10197-21taskset23:29:353
1512399815,54cyclictest25427-21apt-get23:54:422
15123998134,35cyclictest0-21swapper/221:39:392
15123998053,20cyclictest7152-21sh00:17:212
15123998050,24cyclictest343-21runrttasks00:34:442
15123998050,24cyclictest343-21runrttasks00:34:442
15123998034,33cyclictest0-21swapper/220:04:372
15123998032,34cyclictest0-21swapper/220:49:352
15123998020,29cyclictest19526-21tune2fs23:44:482
15123998019,27cyclictest0-21swapper/220:30:012
15123997924,25cyclictest7396-21seq20:23:492
15123997924,25cyclictest26667-21seq19:43:352
15123997924,25cyclictest26667-21seq19:43:352
15123997924,23cyclictest28210-21seq19:47:442
15117997949,22cyclictest28633-21apt-key19:49:281
1513099782,32cyclictest9395-21chrt21:39:583
15123997858,14cyclictest6859-21latency22:29:502
15123997837,36cyclictest0-21swapper/200:29:352
15123997832,33cyclictest0-21swapper/221:44:372
15123997819,29cyclictest15084-21runrttasks23:37:132
15117997861,9cyclictest17363-21sh21:54:261
15117997861,9cyclictest17363-21sh21:54:261
15117997854,18cyclictest22489-21diskmemload23:49:561
1513099773,30cyclictest8085-21chrt20:24:493
1513099773,30cyclictest8085-21chrt20:24:493
15123997723,20cyclictest0-21swapper/220:02:172
1511799779,25cyclictest20705-21runrttasks21:59:411
1513099762,35cyclictest8153-21taskset22:31:503
15123997640,30cyclictest14611-21ssh21:49:382
15123997640,30cyclictest14611-21ssh21:49:382
15123997624,23cyclictest15643-21taskset20:47:282
15117997658,12cyclictest526-21rs:main1
15117997658,12cyclictest526-21rs:main1
15117997656,13cyclictest0-21swapper/123:47:001
15117997650,17cyclictest0-21swapper/120:09:261
1511799763,31cyclictest2686-21runrttasks21:29:421
1511799763,31cyclictest2686-21runrttasks21:29:421
1513099753,29cyclictest20880-21chrt19:24:473
15123997533,32cyclictest0-21swapper/200:04:352
15123997533,32cyclictest0-21swapper/200:04:352
15117997561,9cyclictest32435-21kworker/u17:2-ext4-rsv-conversion22:34:261
15117997556,13cyclictest29625-21ssh22:14:271
15117997551,15cyclictest9553-21apt-key20:29:281
15117997551,15cyclictest9553-21apt-key20:29:281
15123997450,16cyclictest662-21cron19:19:242
15123997446,19cyclictest2207-21apt-get00:09:342
15123997436,33cyclictest0-21swapper/222:14:392
15123997436,33cyclictest0-21swapper/222:14:392
15123997434,28cyclictest21163-21apt-get21:05:222
15117997447,15cyclictest0-21swapper/120:49:581
1513099734,28cyclictest13806-21chrt00:29:073
1513099734,28cyclictest13806-21chrt00:29:073
15123997346,18cyclictest6974-21latency_hist23:24:262
15123997332,30cyclictest17614-21/usr/sbin/munin21:54:352
15117997352,16cyclictest15095-21cyclictest00:22:471
1511799732,41cyclictest21163-21apt-get21:05:211
1513099723,29cyclictest23937-21chrt23:51:473
1513099723,28cyclictest3689-21taskset20:09:593
15123997255,10cyclictest26306-21ssh21:14:512
15123997255,10cyclictest26306-21ssh21:14:512
15123997233,28cyclictest23877-21unixbench_singl21:10:022
15123997233,28cyclictest23877-21unixbench_singl21:10:022
15123997231,20cyclictest343-21runrttasks20:57:302
15123997230,37cyclictest0-21swapper/222:09:382
15123997226,36cyclictest8551-21fschecks_time00:19:452
15123997221,21cyclictest0-21swapper/219:38:012
15123997221,21cyclictest0-21swapper/219:38:012
15123997219,25cyclictest343-21runrttasks20:16:112
15123997219,25cyclictest343-21runrttasks20:16:112
15123997218,25cyclictest30162-21runrttasks19:54:082
15117997255,10cyclictest10456-21fschecks_count23:29:451
15117997249,12cyclictest0-21swapper/121:54:481
15117997249,12cyclictest0-21swapper/120:44:471
15117997248,16cyclictest21949-21kworker/u19:0-rpciod22:46:281
15117997215,23cyclictest0-21swapper/120:09:451
15123997149,16cyclictest15095-21cyclictest00:24:532
15123997149,16cyclictest15095-21cyclictest00:24:532
15123997141,23cyclictest3394-21ssh22:24:402
15123997141,23cyclictest3394-21ssh22:24:402
15123997140,25cyclictest22489-21diskmemload22:39:402
15123997140,25cyclictest22489-21diskmemload22:39:402
15123997133,33cyclictest0-21swapper/222:54:372
15123997132,34cyclictest0-21swapper/222:19:372
15123997128,32cyclictest23618-21sed22:04:272
15117997157,10cyclictest15095-21cyclictest21:28:041
15117997150,15cyclictest14219-21systemd-run20:44:241
15117997150,15cyclictest14219-21systemd-run20:44:241
15117997150,15cyclictest1001-21sh22:19:581
15117997148,13cyclictest0-21swapper/119:50:161
15117997147,17cyclictest31647-21/usr/sbin/munin00:04:521
15117997147,17cyclictest31647-21/usr/sbin/munin00:04:521
1513099702,28cyclictest30346-21taskset19:54:283
1512399703,40cyclictest11950-21cat20:34:592
1512399703,40cyclictest11950-21cat20:34:592
15123997020,25cyclictest343-21runrttasks19:58:132
15123997020,25cyclictest343-21runrttasks19:58:132
1511799709,25cyclictest31129-21seq21:23:091
15117997054,11cyclictest15095-21cyclictest19:29:281
15117997049,15cyclictest526-21rs:main1
15117997045,17cyclictest15095-21cyclictest23:14:261
15117997030,31cyclictest20416-21cat19:24:271
1513099692,35cyclictest2740-21chrt21:29:443
1513099692,35cyclictest2740-21chrt21:29:443
15123996949,13cyclictest0-21swapper/222:34:342
15123996949,13cyclictest0-21swapper/222:34:342
15123996940,20cyclictest10192-21apt-get23:29:342
15123996938,22cyclictest7282-21cpuspeed23:24:402
15123996938,22cyclictest7282-21cpuspeed23:24:402
15123996932,27cyclictest2485-21apt-get21:29:382
15123996932,27cyclictest2485-21apt-get21:29:382
15123996931,32cyclictest0-21swapper/223:09:382
15123996931,29cyclictest15160-21apt-get22:44:402
15123996930,33cyclictest0-21swapper/223:04:382
15117996949,14cyclictest24535-21timerandwakeup19:34:591
15117996949,14cyclictest24535-21timerandwakeup19:34:591
15117996945,14cyclictest25626-21rm21:14:271
15117996945,14cyclictest25626-21rm21:14:271
1511799694,43cyclictest24302-21ntp_offset22:04:541
1511799693,25cyclictest0-21swapper/119:14:251
1511799693,25cyclictest0-21swapper/119:14:251
1513099682,27cyclictest1625-21chrt22:20:323
15123996838,21cyclictest23703-21apt-get22:04:372
15123996835,24cyclictest20561-21apt-get19:24:352
15123996828,30cyclictest2272-21users23:15:022
15123996828,30cyclictest2272-21users23:15:022
15117996853,10cyclictest5061-21timerandwakeup23:19:581
15117996844,14cyclictest22489-21diskmemload22:25:341
15117996844,14cyclictest22489-21diskmemload22:25:341
1511799683,44cyclictest25654-21fschecks_time19:39:461
1511799683,44cyclictest25654-21fschecks_time19:39:461
1511799683,22cyclictest30742-21sed22:15:001
1511799683,22cyclictest30742-21sed22:15:001
15123996736,26cyclictest0-21swapper/219:19:422
15117996746,11cyclictest0-21swapper/120:35:001
15117996746,11cyclictest0-21swapper/120:35:001
15117996745,7cyclictest181rcu_preempt20:19:591
15117996739,19cyclictest11477-21fschecks_count00:24:451
15117996739,19cyclictest11477-21fschecks_count00:24:451
15117996730,19cyclictest4991-21latency_hist00:14:261
1513099663,31cyclictest21922-21chrt23:49:243
15123996632,26cyclictest24672-21/usr/sbin/munin22:59:392
15117996646,13cyclictest0-21swapper/123:24:511
15117996646,13cyclictest0-21swapper/123:24:511
15117996644,12cyclictest0-21swapper/123:09:261
15117996637,20cyclictest0-21swapper/120:59:241
15117996623,10cyclictest0-21swapper/100:00:261
1511799655,44cyclictest15786-21runrttasks23:39:111
1511799652,47cyclictest17417-21cstates19:14:441
1511799647,23cyclictest17758-21seq23:41:151
1511799647,23cyclictest17758-21seq23:41:151
15117996443,12cyclictest0-21swapper/121:40:001
15117996440,15cyclictest0-21swapper/122:39:471
15117996440,15cyclictest0-21swapper/122:39:471
15117996439,17cyclictest317-21dbus-daemon20:04:251
1513099633,41cyclictest14509-21chrt00:29:443
1511799633,20cyclictest30725-21cut19:54:471
1511799633,20cyclictest30725-21cut19:54:471
15117996318,33cyclictest3622-21sh23:18:461
15117996318,33cyclictest3622-21sh23:18:461
15117996248,7cyclictest0-21swapper/121:34:531
15117996221,13cyclictest0-21swapper/122:59:561
15117996144,10cyclictest0-21swapper/100:14:591
15117996141,15cyclictest17155-21latency_hist00:34:271
1511799613,41cyclictest19389-21awk22:49:561
1511799613,38cyclictest343-21runrttasks22:36:411
1511799613,38cyclictest343-21runrttasks22:36:411
1513099602,38cyclictest8048-21taskset00:19:263
15117996036,13cyclictest0-21swapper/119:34:261
1513099593,38cyclictest14323-21taskset22:42:083
1513099593,38cyclictest14323-21taskset22:42:083
15117995943,10cyclictest12175-21ntp_offset21:44:541
15117995942,12cyclictest19323-21cpu20:59:391
1511799592,38cyclictest4988-21runrttasks20:14:511
1511799592,38cyclictest4988-21runrttasks20:14:511
1513099583,38cyclictest26950-21chrt22:09:453
1513099564,44cyclictest0-21swapper/321:05:213
1513099564,35cyclictest17166-21chrt19:14:353
1513099562,39cyclictest16469-21chrt22:46:143
1513099562,39cyclictest10163-21chrt20:31:213
1513099553,38cyclictest32235-21taskset00:04:513
1513099553,38cyclictest32235-21taskset00:04:513
1513099553,38cyclictest25584-21chrt23:00:003
1513099544,35cyclictest31150-21taskset21:23:123
1513099544,34cyclictest4555-21taskset23:19:463
1513099543,37cyclictest27816-21taskset23:04:423
1513099543,35cyclictest31602-21chrt22:17:073
1513099543,35cyclictest31602-21chrt22:17:073
1513099543,35cyclictest2194-21chrt21:29:243
1513099542,36cyclictest15912-21chrt21:50:363
1513099542,36cyclictest15912-21chrt21:50:363
1513099533,37cyclictest14639-21chrt20:44:463
1513099533,36cyclictest28465-21taskset19:49:263
1513099533,34cyclictest11936-21chrt21:44:483
1513099532,38cyclictest26384-21chrt19:40:023
1513099532,38cyclictest26384-21chrt19:40:023
1513099532,38cyclictest2211-21chrt00:09:343
1513099532,36cyclictest6257-21taskset22:29:273
1513099532,36cyclictest6257-21taskset22:29:273
1513099532,36cyclictest21301-21taskset21:59:563
1513099532,35cyclictest18415-21chrt20:54:583
1513099532,35cyclictest10519-21chrt22:35:033
1513099532,35cyclictest10519-21chrt22:35:033
1513099532,34cyclictest2122-21chrt20:05:013
1513099524,35cyclictest24222-21taskset21:10:523
1513099524,35cyclictest24222-21taskset21:10:523
1513099523,37cyclictest6399-21chrt20:19:473
1513099523,36cyclictest5778-21chrt21:34:473
1513099523,35cyclictest18575-21chrt23:43:323
1513099523,35cyclictest18575-21chrt23:43:323
1513099522,38cyclictest25710-21chrt23:55:023
1513099522,36cyclictest31328-21chrt19:55:013
1513099522,36cyclictest31328-21chrt19:55:013
1513099522,36cyclictest15909-21chrt19:09:573
1513099522,36cyclictest15909-21chrt19:09:573
1513099522,33cyclictest31505-21taskset23:10:013
1513099514,34cyclictest18898-21chrt21:55:313
1513099512,37cyclictest28900-21chrt00:00:133
1513099512,35cyclictest19620-21taskset00:38:363
1513099512,35cyclictest19620-21taskset00:38:363
1513099512,33cyclictest24428-21chrt22:04:593
1513099512,32cyclictest32343-21chrt19:59:463
1513099504,33cyclictest13464-21taskset20:39:563
1513099504,33cyclictest13464-21taskset20:39:563
1513099504,30cyclictest16132-21taskset23:39:273
1513099503,34cyclictest24647-21chrt19:35:003
1513099503,34cyclictest24647-21chrt19:35:003
1513099503,33cyclictest19263-21chrt19:19:493
1513099503,32cyclictest1560-21chrt23:14:473
1513099503,32cyclictest1560-21chrt23:14:473
1393625010,25sleep30-21swapper/319:04:533
1393625010,25sleep30-21swapper/319:04:533
1513099493,29cyclictest7614-21chrt23:24:493
1513099493,29cyclictest7614-21chrt23:24:493
1513099492,34cyclictest9507-21taskset00:20:283
1513099472,29cyclictest18637-21chrt22:49:343
1513099443,30cyclictest20293-21chrt21:00:003
1513099442,29cyclictest16604-21taskset20:49:523
1513099423,28cyclictest23418-21chrt19:33:263
1513099413,27cyclictest25866-21chrt21:14:413
1513099413,27cyclictest25866-21chrt21:14:413
1513099403,26cyclictest4445-21taskset20:14:283
1513099403,26cyclictest4445-21taskset20:14:283
1513099372,26cyclictest12218-21taskset20:35:063
1513099372,26cyclictest12218-21taskset20:35:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional