You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 23:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun Jul 05, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15911991413,47cyclictest31260-21ssh11:52:510
159119913445,18cyclictest23613-21fschecks_count08:58:010
159119912854,11cyclictest0-21swapper/009:07:420
1562521226,15sleep00-21swapper/006:55:390
2214921050,7sleep10-21swapper/109:48:331
159179910448,8cyclictest181rcu_preempt10:32:541
15917999972,18cyclictest31570-21fschecks_time11:53:031
15911999869,21cyclictest10506-21gpgv12:12:420
15911999674,12cyclictest15903-21cyclictest07:57:550
15917999469,16cyclictest9889-21sh10:23:011
15911999055,13cyclictest0-21swapper/011:13:000
15911998968,14cyclictest25990-21rm09:55:560
15911998762,16cyclictest23064-21diskmemload11:22:500
15911998762,16cyclictest23064-21diskmemload11:22:500
15926998658,20cyclictest16291-21sh12:21:342
15917998553,12cyclictest181rcu_preempt10:37:551
15917998533,9cyclictest181rcu_preempt07:57:521
15911998560,13cyclictest0-21swapper/010:23:020
1522928511,33sleep20-21swapper/206:53:242
15926998451,24cyclictest20511-21sshd10:40:172
15911998451,13cyclictest181rcu_preempt10:57:540
15911998451,13cyclictest181rcu_preempt10:57:540
15917998350,11cyclictest181rcu_preempt08:43:451
15917998350,11cyclictest181rcu_preempt08:43:451
15926998264,12cyclictest19676-21snmpd07:37:422
15926998255,19cyclictest7622-21sh11:13:032
15911998259,14cyclictest16681-21cpuspeed08:37:560
15926998158,17cyclictest544-21cron09:32:392
15917998162,13cyclictest29104-21awk09:07:391
15917998152,20cyclictest8598-21cron09:27:391
15917998152,20cyclictest8598-21cron09:27:391
15917998152,11cyclictest58-21kcompactd008:12:561
15917998152,11cyclictest58-21kcompactd008:12:561
15911998163,11cyclictest14778-21apt-key08:32:430
15911998160,15cyclictest7432-21ssh12:07:370
15911998159,16cyclictest15903-21cyclictest07:13:010
15911998159,16cyclictest15903-21cyclictest07:13:010
15911998158,13cyclictest0-21swapper/007:08:170
15911998155,18cyclictest8245-21latency_hist08:12:420
15911998155,18cyclictest8245-21latency_hist08:12:420
15911998140,31cyclictest0-21swapper/011:07:180
15911998140,26cyclictest18049-21ssh10:36:460
15926998058,16cyclictest20137-21sh09:46:222
15926998053,20cyclictest5607-21sh10:15:332
15917998062,13cyclictest2707-21timerandwakeup11:58:171
15917998056,16cyclictest15903-21cyclictest07:53:041
15911998059,7cyclictest181rcu_preempt11:41:110
15911998053,19cyclictest19649-21latency_hist07:07:420
15911998052,19cyclictest10559-21fschecks_time11:18:010
15911998052,17cyclictest9811-21latency_hist08:17:420
15911998052,17cyclictest9811-21latency_hist08:17:420
15926997956,14cyclictest23064-21diskmemload11:02:022
15926997956,14cyclictest23064-21diskmemload11:02:022
15926997954,18cyclictest352-21runrttasks10:02:592
15917997960,13cyclictest352-21runrttasks12:06:461
15911997956,12cyclictest0-21swapper/009:38:120
15911997944,27cyclictest742-21kworker/u17:0+nfsiod12:27:410
15911997911,37cyclictest15944-21ssh12:20:350
15926997861,11cyclictest1561-21ssh11:03:022
15926997855,17cyclictest23064-21diskmemload11:47:322
15917997856,17cyclictest23064-21diskmemload09:58:071
15917997856,17cyclictest23064-21diskmemload09:58:071
15911997854,15cyclictest19798-21cron08:47:400
15911997854,15cyclictest19798-21cron08:47:400
15911997853,10cyclictest181rcu_preempt07:32:520
15911997851,19cyclictest1554-21fschecks_count10:09:410
15911997851,19cyclictest1554-21fschecks_count10:09:410
1577627812,43sleep115792-21modprobe06:57:391
1592699778,60cyclictest11359-21dpkg12:13:472
15926997757,13cyclictest298-21in:imuxsock08:07:402
15926997757,13cyclictest298-21in:imuxsock08:07:402
15911997754,14cyclictest11247-21diskmemload09:31:350
15911997754,12cyclictest0-21swapper/008:27:430
15911997747,21cyclictest16294-21fschecks_count06:58:010
1591199773,33cyclictest15030-21dpkg08:33:130
15926997653,15cyclictest352-21runrttasks09:52:082
15917997644,23cyclictest26134-21wc11:43:151
15917997635,8cyclictest181rcu_preempt10:28:001
15917997635,8cyclictest181rcu_preempt10:28:001
15911997659,12cyclictest12045-21kworker/u17:4+nfsiod10:27:570
15911997659,12cyclictest12045-21kworker/u17:4+nfsiod10:27:570
1591199763,34cyclictest32436-21runrttasks09:12:550
1591199763,34cyclictest32436-21runrttasks09:12:550
15926997552,16cyclictest32270-21ssh11:53:172
15926997545,23cyclictest2933-21sh09:17:512
15911997554,10cyclictest0-21swapper/008:52:420
15911997553,12cyclictest0-21swapper/007:22:420
1591199754,55cyclictest9368-21idleruntime-cro10:22:390
1591199753,30cyclictest10095-21fschecks_count08:18:010
15911997518,30cyclictest0-21swapper/011:49:080
15911997518,30cyclictest0-21swapper/011:49:080
1592699749,54cyclictest17960-21apt-get08:42:542
1592699749,54cyclictest17960-21apt-get08:42:542
15926997453,14cyclictest11259-21grep08:22:412
15926997448,18cyclictest7334-21sh10:18:122
1592699744,42cyclictest17500-21latency_hist07:02:412
15926997420,9cyclictest0-21swapper/211:37:422
15917997458,10cyclictest277-21dbus-daemon08:42:411
15917997451,17cyclictest8130-21ssh11:13:141
15917997442,13cyclictest7900-21ssh10:18:341
15917997438,8cyclictest181rcu_preempt07:17:511
15917997436,11cyclictest0-21swapper/112:21:281
15911997454,9cyclictest0-21swapper/009:12:420
1591199743,57cyclictest17159-21grep11:28:140
15926997317,26cyclictest0-21swapper/209:38:022
15926997315,12cyclictest0-21swapper/210:53:152
15917997350,17cyclictest300-21rs:main1
15917997348,15cyclictest0-21swapper/111:17:511
15917997343,10cyclictest351-21cmp10:07:421
15917997342,11cyclictest181rcu_preempt08:57:521
1591799733,35cyclictest20231-21expr08:47:581
15917997316,26cyclictest27191-21grep07:28:171
15911997349,17cyclictest23605-21kworker/u18:1+events_unbound12:02:390
15911997348,15cyclictest12192-21ssh12:14:130
165102720,7sleep30-21swapper/309:39:353
15926997248,18cyclictest0-21swapper/212:08:152
15926997246,14cyclictest0-21swapper/208:02:422
1592699724,57cyclictest32592-21apt-get10:07:522
1592699724,57cyclictest32592-21apt-get10:07:522
1592699724,44cyclictest17235-21apt-get12:22:562
15926997232,30cyclictest1777-21kworker/u19:0+nfsiod09:23:522
15926997232,30cyclictest1777-21kworker/u19:0+nfsiod09:23:522
15926997218,14cyclictest0-21swapper/208:38:072
15917997249,16cyclictest3883-21ssh10:12:581
15917997239,11cyclictest181rcu_preempt09:18:241
15911997252,11cyclictest0-21swapper/007:57:410
15911997251,12cyclictest14545-21sh09:37:290
15911997248,15cyclictest27818-21kworker/u18:3-nfsiod11:43:040
15911997247,16cyclictest5528-21ssh09:22:250
15926997153,12cyclictest15903-21cyclictest07:57:432
15926997153,11cyclictest24457-21unixbench_singl08:58:172
1592699714,44cyclictest26450-21fschecks_count07:28:022
15926997135,12cyclictest181rcu_preempt11:08:012
1592699713,45cyclictest23064-21diskmemload12:07:422
1591799712,40cyclictest15003-21taskset08:32:521
15911997152,13cyclictest6925-21latency_hist11:12:400
15911997146,15cyclictest23064-21diskmemload10:05:580
15911997137,22cyclictest27135-21grep07:28:170
15911997136,12cyclictest181rcu_preempt10:52:590
1591199713,57cyclictest3734-21ssh10:12:550
1592699704,45cyclictest12194-21mailstats08:23:132
15926997037,23cyclictest24361-21kernelversion09:53:052
1592699703,46cyclictest13666-21ntp_kernel_pll_08:28:092
1592699703,33cyclictest15516-21latency08:34:172
15926997014,37cyclictest8759-21/usr/sbin/munin08:13:042
15926997014,37cyclictest8759-21/usr/sbin/munin08:13:042
15926997014,37cyclictest32409-21sh07:47:392
15926997014,37cyclictest32409-21sh07:47:392
15917997055,10cyclictest31-21ksoftirqd/110:50:011
15917997054,8cyclictest0-21swapper/110:53:121
1591799704,53cyclictest18163-21sshd07:02:561
1591799704,33cyclictest8754-21/usr/sbin/munin12:08:141
15911997052,10cyclictest0-21swapper/007:38:120
15911997051,7cyclictest181rcu_preempt10:41:070
15911997040,10cyclictest0-21swapper/008:57:430
15911997039,12cyclictest181rcu_preempt11:33:330
15926996951,11cyclictest0-21swapper/209:58:122
15926996951,11cyclictest0-21swapper/209:58:122
15926996950,12cyclictest20609-21/usr/sbin/munin08:48:092
15926996948,15cyclictest27204-21switchtime09:03:152
15926996948,12cyclictest0-21swapper/209:08:132
15926996946,16cyclictest25965-21idleruntime-cro07:27:392
1592699694,51cyclictest15667-21/usr/sbin/munin10:33:032
1592699692,50cyclictest21132-21latency_hist07:12:432
15926996920,14cyclictest21930-21grep10:43:012
15917996940,9cyclictest181rcu_preempt09:12:541
15917996940,9cyclictest181rcu_preempt09:12:541
1591799693,45cyclictest11592-21fschecks_count12:13:581
15917996934,14cyclictest181rcu_preempt11:08:031
1591799693,28cyclictest17980-21if_eth012:24:011
15917996929,11cyclictest181rcu_preempt11:42:411
15917996926,8cyclictest181rcu_preempt10:12:431
1591799692,31cyclictest18204-21fschecks_count09:43:021
15911996948,12cyclictest0-21swapper/010:43:030
15911996948,12cyclictest0-21swapper/009:43:150
15911996939,11cyclictest181rcu_preempt09:22:560
15911996939,11cyclictest181rcu_preempt09:22:560
1591199693,33cyclictest22410-21ssh09:49:150
1592699683,46cyclictest22964-21latency_hist07:17:422
15926996824,14cyclictest181rcu_preempt10:28:142
15926996824,14cyclictest181rcu_preempt10:28:142
15926996823,16cyclictest2338-21netstat11:58:092
15917996836,8cyclictest181rcu_preempt09:39:361
15917996831,9cyclictest15167-21ssh11:25:351
15917996831,9cyclictest15167-21ssh11:25:351
15926996746,14cyclictest13020-21latency_hist11:22:422
1592699674,43cyclictest32387-21/usr/sbin/munin09:13:132
1592699674,43cyclictest32387-21/usr/sbin/munin09:13:132
1592699674,41cyclictest19502-21latency_hist07:07:432
1592699674,39cyclictest352-21runrttasks07:52:232
15926996720,20cyclictest0-21swapper/211:28:142
15926996713,23cyclictest24978-21latency_hist11:42:412
15917996751,11cyclictest26925-21kworker/u17:1-rpciod11:48:151
15917996751,11cyclictest26925-21kworker/u17:1-rpciod11:48:151
1591799674,35cyclictest973-21rm10:08:331
15917996740,9cyclictest10069-21kworker/u18:1-rpciod09:53:541
15917996737,20cyclictest8038-21modprobe08:12:381
15917996737,20cyclictest8038-21modprobe08:12:381
15917996734,8cyclictest181rcu_preempt09:27:511
15917996727,8cyclictest181rcu_preempt10:43:061
15911996743,13cyclictest0-21swapper/008:03:070
15911996743,13cyclictest0-21swapper/008:03:070
15911996737,24cyclictest28319-21ssh09:59:050
15911996737,24cyclictest28319-21ssh09:59:050
1592699669,26cyclictest373-21lldpd07:13:062
15917996647,13cyclictest14611-21apt-key08:32:421
15917996647,10cyclictest648-21latency07:48:051
15917996643,13cyclictest0-21swapper/109:12:411
15917996634,9cyclictest3958-21sendmail11:07:391
1591799663,37cyclictest12446-21unixbench_multi08:23:161
15926996537,20cyclictest24331-21cron07:22:392
1592699653,45cyclictest11927-21/usr/sbin/munin09:33:162
1592699653,31cyclictest28877-21open_files11:48:102
1592699653,31cyclictest28877-21open_files11:48:102
15926996524,11cyclictest181rcu_preempt11:23:152
15926996524,11cyclictest181rcu_preempt11:23:152
15926996510,36cyclictest24828-21cstates10:47:582
15917996545,14cyclictest22749-21cut07:17:411
15917996545,14cyclictest22749-21cut07:17:411
1591799653,39cyclictest10575-21mailstats08:18:131
15917996528,11cyclictest181rcu_preempt07:08:131
15926996446,12cyclictest23058-21latency_hist08:57:422
15926996444,10cyclictest0-21swapper/210:25:062
15917996447,9cyclictest0-21swapper/111:27:521
15917996444,10cyclictest0-21swapper/107:47:411
15917996444,10cyclictest0-21swapper/107:47:411
15917996432,9cyclictest13831-21ssh09:35:291
15911996432,14cyclictest32702-21runrttasks07:47:550
15911996413,12cyclictest181rcu_preempt10:48:180
1592699634,38cyclictest352-21runrttasks08:08:302
1592699634,38cyclictest352-21runrttasks08:08:302
15917996328,9cyclictest181rcu_preempt11:32:531
15917996325,25cyclictest28632-21timerandwakeup07:33:151
1591799632,43cyclictest16847-21sort06:58:141
1591199633,41cyclictest352-21runrttasks07:44:560
1591199633,41cyclictest352-21runrttasks07:44:560
15926996239,12cyclictest0-21swapper/207:37:592
15917996246,9cyclictest0-21swapper/110:58:071
15917996246,9cyclictest0-21swapper/110:58:071
1591799623,42cyclictest29691-21fschecks_time07:37:591
15917996229,9cyclictest181rcu_preempt07:23:091
1593499603,41cyclictest917-21kworker/3:1+events12:06:463
15917996024,9cyclictest181rcu_preempt08:07:431
15917996024,9cyclictest181rcu_preempt08:07:431
1593499594,37cyclictest31323-21taskset07:43:013
1593499594,37cyclictest31323-21taskset07:43:013
15911995935,16cyclictest0-21swapper/007:23:160
1593499573,35cyclictest1829-21chrt09:15:273
1593499573,35cyclictest1829-21chrt09:15:273
1593499563,40cyclictest10013-21chrt09:28:163
1593499563,37cyclictest25418-21taskset07:23:173
1593499552,34cyclictest7154-21chrt08:08:043
1593499552,34cyclictest7154-21chrt08:08:043
1593499543,35cyclictest12073-21chrt08:23:113
1593499542,41cyclictest30809-21taskset09:09:063
1593499533,39cyclictest2676-21chrt07:53:143
1593499533,37cyclictest11770-21taskset10:26:023
1593499532,38cyclictest5033-21chrt10:13:543
1593499532,38cyclictest25294-21chrt09:53:593
1593499524,38cyclictest31586-21chrt11:53:033
1593499523,35cyclictest5379-21chrt11:08:193
1462625215,21sleep30-21swapper/306:53:053
1593499513,35cyclictest8472-21chrt08:12:593
1593499513,35cyclictest8472-21chrt08:12:593
1593499512,39cyclictest23950-21chrt11:39:573
1593499504,33cyclictest15360-21chrt10:32:393
1593499504,33cyclictest15360-21chrt10:32:393
1593499503,38cyclictest16693-21chrt12:22:383
1593499503,35cyclictest28485-21taskset11:48:003
1593499503,35cyclictest28485-21taskset11:48:003
1593499503,35cyclictest13345-21chrt08:28:013
1593499503,34cyclictest5546-21chrt08:03:063
1593499503,34cyclictest5546-21chrt08:03:063
1593499503,34cyclictest20195-21chrt07:08:063
1593499502,34cyclictest24288-21taskset08:58:153
1593499502,33cyclictest18409-21chrt08:42:443
1593499493,37cyclictest917-21kworker/3:1+events10:58:263
1593499493,37cyclictest917-21kworker/3:1+events10:58:263
1593499493,34cyclictest3407-21chrt09:18:063
1593499493,34cyclictest25516-21taskset11:43:013
1593499493,31cyclictest735-21chrt07:48:083
1593499493,31cyclictest20294-21chrt11:33:163
1593499492,37cyclictest31248-21chrt10:03:563
1593499492,31cyclictest11905-21chrt11:19:503
1593499492,29cyclictest18521-21chrt10:37:413
1593499483,34cyclictest7233-21chrt11:12:493
1593499483,31cyclictest28022-21chrt07:33:013
15934994827,14cyclictest263562sleep309:02:513
1593499482,37cyclictest26295-21taskset10:49:383
1593499482,34cyclictest6182-21chrt09:23:013
1593499482,34cyclictest6182-21chrt09:23:013
1593499482,33cyclictest9701-21chrt12:10:303
1593499482,32cyclictest19162-21chrt10:38:063
1593499473,33cyclictest14886-21chrt11:24:493
1593499473,33cyclictest14886-21chrt11:24:493
1593499473,32cyclictest4898-21taskset08:02:423
1593499463,34cyclictest2198-21chrt11:58:063
1593499463,34cyclictest13513-21chrt12:17:113
1593499463,28cyclictest27979-21chrt09:58:163
1593499463,28cyclictest27979-21chrt09:58:163
1593499453,32cyclictest18685-21chrt11:31:583
1593499453,29cyclictest6789-21chrt10:17:553
1593499453,26cyclictest23547-21chrt10:45:243
1593499443,30cyclictest2020-21chrt10:09:523
1593499443,30cyclictest2020-21chrt10:09:523
1593499443,29cyclictest1929-21taskset11:03:123
15934994424,9cyclictest195122chrt08:44:143
15934994424,9cyclictest195122chrt08:44:143
1593499442,32cyclictest19148-21chrt12:25:303
1593499433,29cyclictest20976-21chrt09:47:543
1593499433,29cyclictest18583-21taskset07:03:073
1593499433,28cyclictest11954-21chrt09:32:503
1593499432,30cyclictest28963-21taskset10:53:433
1593499432,28cyclictest917-21kworker/3:1+events09:42:533
15934994311,23cyclictest15047-21chrt08:33:203
1593499423,29cyclictest26784-21taskset07:28:113
1593499422,27cyclictest29458-21taskset07:37:513
1593499413,28cyclictest21483-21chrt08:52:403
1593499413,25cyclictest23265-21taskset08:57:433
1593499403,27cyclictest23155-21taskset07:17:583
1593499403,27cyclictest22404-21taskset07:13:283
1593499403,27cyclictest22404-21taskset07:13:283
1593499403,25cyclictest17667-21taskset07:02:433
1593499402,28cyclictest10967-21taskset08:19:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional