You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-17 - 06:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot4.osadl.org (updated Fri Oct 17, 2025 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2563299772,22cyclictest16399-21sort17:14:311
2563299752,66cyclictest7589-21/usr/sbin/munin13:59:591
2563299742,66cyclictest15106-21/usr/sbin/munin14:20:091
2563299742,66cyclictest15106-21/usr/sbin/munin14:20:091
2563299712,63cyclictest5720-21/usr/sbin/munin13:55:051
2563299693,60cyclictest11891-21aten_rbpower_cu17:54:421
2563299692,60cyclictest11338-21/usr/sbin/munin14:10:011
2563299683,59cyclictest31632-21ls17:35:031
2563299683,59cyclictest0-21swapper/116:49:321
2563299682,60cyclictest28736-21/usr/sbin/munin13:29:531
2563299682,29cyclictest9098-21ssh18:39:291
25632996818,45cyclictest20042-21aten_rbpower_vo17:19:421
2563299674,57cyclictest0-21swapper/115:59:331
2563299672,59cyclictest9466-21/usr/sbin/munin14:05:031
2563299672,59cyclictest4389-21ssh17:43:491
2563299672,59cyclictest18852-21/usr/sbin/munin14:29:521
25632996713,48cyclictest0-21swapper/115:28:421
25632996712,49cyclictest0-21swapper/118:07:511
236732670,5sleep00-21swapper/017:24:470
2563299663,27cyclictest0-21swapper/116:21:441
2563299663,27cyclictest0-21swapper/116:21:441
2563299662,32cyclictest16567-21grep17:14:451
25632996616,45cyclictest5007-21diskmemload17:48:441
25632996614,22cyclictest31867-21sshd13:35:091
25632996611,49cyclictest0-21swapper/115:30:171
2563299658,51cyclictest0-21swapper/116:43:271
2563299653,29cyclictest14224-21ssh18:47:001
2563299652,57cyclictest3353-21/usr/sbin/munin15:15:041
2563299652,57cyclictest30105-21/usr/sbin/munin14:59:541
2563299652,57cyclictest24477-21/usr/sbin/munin14:44:551
2563299652,57cyclictest1610-21seq16:52:441
2563299652,57cyclictest13218-21ksmtuned14:14:381
2563299652,57cyclictest13218-21ksmtuned14:14:381
2563299652,30cyclictest20724-21/usr/sbin/munin14:35:011
25632996513,47cyclictest26672-21switchtime18:15:011
25632996511,22cyclictest0-21swapper/117:00:311
25632996510,49cyclictest0-21swapper/118:42:421
25643996420,11cyclictest21923-21tr16:34:563
2563299649,49cyclictest0-21swapper/116:11:071
2563299645,27cyclictest0-21swapper/118:23:051
2563299644,54cyclictest0-21swapper/115:36:441
2563299644,27cyclictest0-21swapper/116:04:431
2563299643,55cyclictest28429-21ssh17:30:211
2563299642,57cyclictest32283-21ssh16:04:101
2563299642,57cyclictest29103-21sendmail_mailqu14:55:011
2563299642,56cyclictest3847-21/usr/sbin/munin13:49:521
2563299642,56cyclictest31972-21/usr/sbin/munin15:04:461
2563299642,30cyclictest16948-21ssh18:00:371
2563299642,28cyclictest1459-21/usr/sbin/munin15:10:031
2563299639,28cyclictest7519-21taskset16:14:481
2563299638,49cyclictest0-21swapper/115:42:481
2563299637,24cyclictest0-21swapper/116:30:221
2563299634,53cyclictest0-21swapper/116:35:521
2563299633,54cyclictest5109-21ssh18:31:561
2563299633,54cyclictest11156-21ssh17:53:281
2563299632,55cyclictest26581-21ssh15:54:051
2563299632,55cyclictest23446-21/usr/sbin/munin17:25:041
2563299632,55cyclictest16970-21/usr/sbin/munin14:25:021
2563299629,48cyclictest14226-21ps16:24:451
2563299626,51cyclictest5007-21diskmemload15:20:401
2563299624,52cyclictest0-21swapper/117:06:471
2563299624,52cyclictest0-21swapper/115:45:251
2563299623,53cyclictest24408-21ssh18:11:561
25632996226,31cyclictest1970-21/usr/sbin/munin13:45:021
2563299622,54cyclictest32518-21tr13:39:511
2563299622,54cyclictest26360-21/usr/sbin/munin14:49:521
2563299622,35cyclictest1780-21taskset18:26:221
25643996118,37cyclictest3932-21ssh18:29:573
25643996118,37cyclictest24031-21ssh17:24:523
25643996117,37cyclictest25685-21ntp_states13:19:383
2563299613,52cyclictest22596-21/usr/sbin/munin14:39:541
25643996015,39cyclictest20091-21/usr/sbin/munin15:44:553
2563299602,52cyclictest4271-21ssh16:55:431
25628996010,5cyclictest0-21swapper/018:11:300
25643995917,35cyclictest13567-21/usr/sbin/munin17:09:523
25643995822,12cyclictest2142-21/usr/sbin/munin17:39:513
25643995821,32cyclictest5007-21diskmemload16:45:193
25643995817,35cyclictest18395-21needreboot16:29:563
2563299583,49cyclictest28049-21latency_hist13:24:371
25643995717,34cyclictest2628-21/usr/sbin/munin16:54:593
25643995715,36cyclictest10560-21grep18:40:013
2562899564,46cyclictest0-21swapper/016:29:420
25628995543,8cyclictest3-21ksoftirqd/015:29:340
2562899554,46cyclictest0-21swapper/018:35:200
2562899544,44cyclictest0-21swapper/017:10:210
2563799534,24cyclictest0-21swapper/215:21:272
2563799533,46cyclictest0-21swapper/217:39:412
2563799533,44cyclictest7082-21sendmail_mailtr17:00:002
2562899534,16cyclictest0-21swapper/016:00:000
2562899524,43cyclictest0-21swapper/018:02:100
2562899524,43cyclictest0-21swapper/016:11:430
2562899524,42cyclictest0-21swapper/017:21:210
2562899522,6cyclictest12918-21ssh15:31:340
2563799513,43cyclictest0-21swapper/216:55:132
2563299514,42cyclictest0-21swapper/113:25:531
253382517,15sleep20-21swapper/213:19:022
25637995041,5cyclictest29-21ksoftirqd/218:19:302
2562899504,40cyclictest0-21swapper/017:35:120
2562899504,40cyclictest0-21swapper/016:35:370
2562899503,43cyclictest0-21swapper/015:45:380
2562899503,41cyclictest10475-21latency_hist16:19:330
250972509,13sleep10-21swapper/113:16:121
2563799494,8cyclictest0-21swapper/215:43:432
2562899494,6cyclictest0-21swapper/018:06:100
2562899493,42cyclictest0-21swapper/015:44:230
2562899493,40cyclictest15230-21ssh15:34:540
2562899493,40cyclictest0-21swapper/016:52:160
25628994910,6cyclictest0-21swapper/017:32:590
253712498,13sleep30-21swapper/313:19:273
25643994817,25cyclictest17437-21sh18:01:493
2563799483,40cyclictest0-21swapper/216:41:422
2563799483,40cyclictest0-21swapper/216:13:032
25637994816,26cyclictest5007-21diskmemload17:07:012
25637994811,31cyclictest0-21swapper/218:48:332
25637994811,31cyclictest0-21swapper/217:49:162
2562899484,6cyclictest0-21swapper/016:05:430
2562899484,39cyclictest0-21swapper/017:49:550
2562899484,38cyclictest0-21swapper/018:24:160
2562899483,40cyclictest0-21swapper/017:47:410
2562899483,40cyclictest0-21swapper/017:00:220
25628994811,5cyclictest0-21swapper/016:48:350
25643994729,13cyclictest15152-21needreboot15:34:513
25643994725,16cyclictest27999-21crond14:54:343
2563799474,39cyclictest0-21swapper/217:32:412
2563799474,37cyclictest0-21swapper/217:55:252
2563799474,37cyclictest0-21swapper/216:34:342
2563799474,37cyclictest0-21swapper/215:34:132
2563799473,40cyclictest0-21swapper/215:58:432
2563799473,39cyclictest0-21swapper/217:20:412
25637994716,26cyclictest28851-21ntp_kernel_pll_16:44:562
2562899478,7cyclictest0-21swapper/016:58:020
2562899474,38cyclictest0-21swapper/015:50:000
2562899474,37cyclictest0-21swapper/017:44:130
2562899474,37cyclictest0-21swapper/016:42:370
2562899474,37cyclictest0-21swapper/015:54:350
2562899473,40cyclictest0-21swapper/018:26:000
2562899473,40cyclictest0-21swapper/017:07:570
2562899473,38cyclictest0-21swapper/015:19:500
2562899473,37cyclictest9453-21/usr/sbin/munin18:39:440
2562899472,15cyclictest26239-21/usr/sbin/munin13:19:570
25643994618,22cyclictest12057-21unixbench_multi16:20:043
25643994618,22cyclictest12057-21unixbench_multi16:20:043
2563799467,33cyclictest0-21swapper/216:25:382
2563799465,34cyclictest0-21swapper/215:48:332
2563799464,37cyclictest0-21swapper/217:51:002
2563799464,37cyclictest0-21swapper/215:39:152
2563799464,36cyclictest0-21swapper/218:11:032
2563799464,36cyclictest0-21swapper/218:01:292
2563799464,36cyclictest0-21swapper/217:15:332
25637994637,5cyclictest29-21ksoftirqd/214:19:352
25637994637,5cyclictest29-21ksoftirqd/214:19:352
2563799463,38cyclictest0-21swapper/218:27:192
25637994610,5cyclictest0-21swapper/216:07:352
2562899464,37cyclictest0-21swapper/018:31:460
2562899464,37cyclictest0-21swapper/016:21:380
2562899464,37cyclictest0-21swapper/016:21:380
2562899464,36cyclictest0-21swapper/017:58:070
2562899464,36cyclictest0-21swapper/016:26:190
2562899463,38cyclictest0-21swapper/014:21:560
2562899463,38cyclictest0-21swapper/014:21:560
25628994611,30cyclictest0-21swapper/017:16:180
25643994529,11cyclictest29159-21ls14:55:033
25643994525,14cyclictest5483-21/usr/sbin/munin17:44:493
25643994522,18cyclictest17386-21open_inodes17:14:593
2563799455,7cyclictest0-21swapper/216:30:332
2563799455,7cyclictest0-21swapper/216:00:152
2563799454,36cyclictest0-21swapper/218:37:402
2563799454,35cyclictest0-21swapper/217:12:382
2563799453,38cyclictest0-21swapper/217:36:012
2562899458,31cyclictest0-21swapper/018:14:390
2562899455,35cyclictest0-21swapper/018:44:570
25643994427,11cyclictest6339-21ls13:54:593
25643994427,11cyclictest19674-21/usr/sbin/munin18:04:573
25643994427,11cyclictest19420-21grep14:29:553
25643994426,13cyclictest6774-21/usr/sbin/munin16:59:543
25643994425,13cyclictest26815-21sshd16:42:103
25643994418,20cyclictest12418-21sh17:08:463
2563799445,33cyclictest0-21swapper/218:08:222
2563799444,35cyclictest0-21swapper/218:41:482
2563799443,35cyclictest0-21swapper/216:49:522
2562899444,35cyclictest0-21swapper/013:27:360
2562899443,6cyclictest0-21swapper/014:47:150
25643994327,11cyclictest24898-21ls14:44:553
25643994324,13cyclictest667-21runrttasks14:27:133
25643994324,13cyclictest30867-21sh18:21:293
25643994323,15cyclictest29216-21/usr/sbin/munin15:59:513
25643994323,15cyclictest23682-21timerwakeupswit14:40:023
25643994323,14cyclictest26647-21/usr/sbin/munin18:15:003
25643994323,14cyclictest24444-21open_files15:50:003
25643994322,14cyclictest9063-21/usr/sbin/munin17:49:523
25643994320,17cyclictest14254-21ssh18:47:053
25643994318,19cyclictest741-21fschecks_time16:04:483
25643994318,19cyclictest2364-21smart_sda15:10:013
25643994318,19cyclictest1792850ssh15:39:503
25643994317,20cyclictest27065-21sh15:54:483
25643994317,20cyclictest10222-21ssh16:18:553
25643994317,19cyclictest14361-21/usr/sbin/munin16:24:463
2563799434,7cyclictest0-21swapper/215:54:142
2563799434,35cyclictest0-21swapper/216:15:332
2563799433,5cyclictest0-21swapper/215:25:342
25643994227,10cyclictest31229-21grep13:34:583
25643994224,12cyclictest7308-21timerandwakeup18:35:023
25643994222,14cyclictest378-21systemd-journal14:20:133
25643994222,14cyclictest378-21systemd-journal14:20:133
25643994220,17cyclictest14073-21ssh15:34:223
25643994216,20cyclictest29867-21sed13:30:023
2563799424,33cyclictest0-21swapper/216:23:152
2563799424,33cyclictest0-21swapper/216:23:152
25643994124,12cyclictest7874-21sh15:23:033
25643994123,13cyclictest5509-21sh16:10:473
25643994122,14cyclictest7614-21grep13:59:453
25643994122,14cyclictest30995-21sort17:34:523
25643994122,14cyclictest26924-21/usr/sbin/munin17:30:033
25643994122,13cyclictest596-21ksmtuned13:27:363
25643994122,13cyclictest23742-21runrttasks18:10:183
25643994121,14cyclictest783-21/usr/sbin/munin18:24:563
25643994121,14cyclictest31750-21runrttasks16:49:493
25643994120,16cyclictest14653-21ssh17:58:333
25643994120,16cyclictest12295-21cat14:10:043
25643994117,18cyclictest32023-21cut15:04:463
25643994116,19cyclictest8953-21df_inode15:24:503
25643994116,19cyclictest539-21iostat_ios13:39:583
25637994132,5cyclictest29-21ksoftirqd/213:49:362
8992403,6sleep20-21swapper/215:05:412
25643994022,13cyclictest20897-21/usr/sbin/munin17:19:563
25643994021,14cyclictest667-21runrttasks15:16:123
25643994021,14cyclictest30865-21runrttasks15:00:023
25643994021,13cyclictest21224-21irqstats14:34:543
25643994017,17cyclictest4326-21interrupts13:49:553
25643994016,18cyclictest13329-21wget14:14:433
25643994016,18cyclictest13329-21wget14:14:433
2562899403,32cyclictest0-21swapper/014:51:460
25643993920,14cyclictest3159-21grep13:45:073
25643993914,19cyclictest9638-21diskstats14:04:493
2562899383,8cyclictest0-21swapper/013:41:370
51182373,6sleep20-21swapper/218:32:002
25628993715,17cyclictest13277-21cut14:14:430
25628993715,17cyclictest13277-21cut14:14:430
113782373,6sleep00-21swapper/014:09:460
46712363,6sleep20-21swapper/215:15:432
278442353,6sleep20-21swapper/213:24:092
202452352,6sleep020249-21ps14:31:390
183692353,6sleep20-21swapper/214:26:382
165662353,6sleep20-21swapper/214:22:282
165662353,6sleep20-21swapper/214:22:282
53962343,6sleep00-21swapper/013:53:280
319532343,6sleep20-21swapper/213:36:002
28352343,6sleep00-21swapper/015:11:100
238642345,22sleep00-21swapper/013:14:500
185522343,6sleep00-21swapper/014:28:410
2563799334,25cyclictest0-21swapper/214:14:222
2563799334,24cyclictest0-21swapper/217:24:322
25637993315,14cyclictest558-21avahi-daemon14:49:342
25628993323,6cyclictest23544-21switchtime14:40:000
2563799324,24cyclictest0-21swapper/213:54:432
2563799323,24cyclictest0-21swapper/214:02:142
25637993222,6cyclictest30292-21ssh18:20:062
25628993222,5cyclictest3-21ksoftirqd/014:59:340
25628993220,7cyclictest3593-21fschecks_count15:14:520
2562899322,24cyclictest3142-21tail13:45:070
2563799314,23cyclictest0-21swapper/213:52:132
2563799314,22cyclictest0-21swapper/215:03:292
25637993119,8cyclictest20023-21grep14:30:062
25637993119,7cyclictest27350-21awk14:50:072
25637993118,8cyclictest2449-21awk15:10:022
25628993119,7cyclictest589-21gdbus13:39:360
25628993119,7cyclictest21450-21tr14:34:580
107952313,6sleep20-21swapper/214:05:502
315932303,6sleep00-21swapper/015:02:450
2562899303,22cyclictest0-21swapper/013:59:490
2563799293,23cyclictest0-21swapper/213:40:082
25637992918,7cyclictest560-21NetworkManager14:39:342
25637992916,8cyclictest29577-21processes13:29:572
25637992911,13cyclictest589-21gdbus14:54:352
25628992917,7cyclictest6041-21cut13:54:530
25628992917,7cyclictest557-21systemd-logind14:09:350
25637992815,8cyclictest557-21systemd-logind14:39:352
25628992818,6cyclictest29155-21idleruntime13:29:480
25637992717,6cyclictest28428-21ksmtuned13:28:362
2562899274,18cyclictest0-21swapper/015:04:490
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional