You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-02 - 23:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Sun Aug 02, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28564991124,31cyclictest28437-21latency_hist06:55:490
285649910948,55cyclictest22251-21/usr/sbin/munin09:26:570
285649910938,8cyclictest0-21swapper/007:50:450
285649910753,48cyclictest11925-21ssh10:01:180
285649910742,59cyclictest3902-21fschecks_time08:56:090
28564991063,34cyclictest1103-21ntpq11:31:120
285649910535,8cyclictest0-21swapper/009:10:480
285769910455,39cyclictest1-21systemd11:47:181
285649910238,8cyclictest0-21swapper/011:05:480
28564991022,40cyclictest32066-21chrt09:41:150
28564991013,42cyclictest3266-21diskmemload12:22:440
285649910036,10cyclictest10483-21ssh09:59:330
28564991003,25cyclictest21806-21kernelversion08:11:120
28564999940,8cyclictest0-21swapper/007:55:560
28564999928,20cyclictest10541-21sort07:36:130
28564999925,22cyclictest28157-21cron09:35:440
2856499986,26cyclictest24001-21apt-get11:16:000
2856499986,26cyclictest24001-21apt-get11:16:000
2856499984,36cyclictest8494-21/usr/sbin/munin07:31:190
28564999816,27cyclictest5670-21cut09:51:210
2858499973,36cyclictest10417-21rm11:47:202
2856499973,32cyclictest5786-21/usr/sbin/munin10:45:550
28564999726,24cyclictest9862-21kworker/u17:0+nfsiod10:29:090
28564999726,24cyclictest9862-21kworker/u17:0+nfsiod10:29:090
28584999647,38cyclictest0-21swapper/210:05:472
2856499963,47cyclictest30532-21ssh12:20:470
2856499963,47cyclictest30532-21ssh12:20:470
2856499953,35cyclictest6567-21apt-get09:00:540
2856499953,32cyclictest28773-21fschecks_count09:36:100
2856499953,32cyclictest28773-21fschecks_count09:36:100
28584999475,12cyclictest32165-21latency_hist10:35:482
28576999469,17cyclictest31715-21ssh12:22:341
2856499944,34cyclictest28308-21latency08:31:080
2856499944,31cyclictest32442-21/usr/sbin/munin10:36:050
2856499943,35cyclictest2217-21ssh09:46:040
2856499943,35cyclictest2217-21ssh09:46:040
2856499934,27cyclictest20769-21/usr/sbin/munin11:11:100
2856499932,40cyclictest10683-21kworker/u19:1+rpciod10:35:160
28584999250,34cyclictest0-21swapper/212:25:482
2856499924,35cyclictest18322-21sh11:06:120
2856499924,35cyclictest18322-21sh11:06:120
2856499924,33cyclictest28968-21fschecks_time06:56:080
2856499923,34cyclictest27239-21grep11:21:070
2856499923,27cyclictest352-21runrttasks10:07:160
28584999149,35cyclictest0-21swapper/210:56:052
28564999138,10cyclictest28553-21cyclictest09:22:010
28584999050,33cyclictest0-21swapper/207:11:492
2858499903,28cyclictest22527-21rm09:26:382
2856499903,41cyclictest352-21runrttasks08:21:430
2856499903,33cyclictest30119-21cpuspeed11:26:020
2856499903,33cyclictest30119-21cpuspeed11:26:020
28576998940,39cyclictest0-21swapper/107:35:481
2856499894,35cyclictest27392-21ssh12:15:440
2856499892,38cyclictest9745-21/usr/sbin/munin11:47:310
28584998847,31cyclictest0-21swapper/212:01:122
28576998850,31cyclictest0-21swapper/109:36:121
28576998850,31cyclictest0-21swapper/109:36:121
284622889,56sleep128477-21systemctl06:55:471
28584998766,14cyclictest12553-21ssh09:10:462
28576998744,37cyclictest0-21swapper/109:10:481
28576998743,37cyclictest0-21swapper/108:36:021
28576998741,38cyclictest0-21swapper/108:31:081
2857699872,38cyclictest13371-21/usr/sbin/munin11:51:141
2856499873,27cyclictest11957-21fschecks_time07:41:090
28584998644,35cyclictest0-21swapper/208:41:232
28576998651,28cyclictest0-21swapper/111:16:431
28576998651,28cyclictest0-21swapper/111:16:431
28576998647,32cyclictest0-21swapper/107:16:121
2857699863,38cyclictest13047-21ssh09:10:561
28564998627,19cyclictest9862-21kworker/u17:0+nfsiod10:11:540
28564998624,16cyclictest0-21swapper/012:00:480
28564998624,16cyclictest0-21swapper/012:00:480
277892867,55sleep227857-21cat06:51:322
28584998569,9cyclictest0-21swapper/209:11:272
28584998545,33cyclictest0-21swapper/207:30:452
2858499852,13cyclictest2374-21systemd-journal11:15:432
28576998512,30cyclictest27104-21cpuspeed11:21:021
28564998529,20cyclictest9862-21kworker/u17:0+nfsiod10:18:480
28564998529,20cyclictest9862-21kworker/u17:0+nfsiod10:18:480
2858499843,60cyclictest25502-21apt-get09:31:002
2858499843,37cyclictest22961-21basename10:20:452
2858499843,37cyclictest22961-21basename10:20:452
2858499842,63cyclictest5357-21ssh09:51:122
2858499842,36cyclictest352-21runrttasks08:56:112
28576998458,8cyclictest181rcu_preempt10:45:591
2857699843,33cyclictest22209-21ssh10:18:441
2857699843,33cyclictest22209-21ssh10:18:441
2858499833,36cyclictest14981-21ssh11:01:062
2858499833,27cyclictest24399-21runrttasks10:21:282
28576998356,19cyclictest352-21runrttasks08:05:481
28576998356,19cyclictest352-21runrttasks08:05:481
2857699833,37cyclictest352-21runrttasks12:03:461
2857699832,36cyclictest1-21systemd09:50:461
2857699832,36cyclictest1-21systemd09:50:461
28584998258,13cyclictest0-21swapper/207:36:092
28584998248,29cyclictest0-21swapper/209:05:492
2858499823,12cyclictest0-21swapper/210:53:002
2858499823,12cyclictest0-21swapper/210:53:002
2858499823,11cyclictest0-21swapper/211:31:052
2857699825,68cyclictest25098-21cat09:30:471
28576998236,40cyclictest0-21swapper/108:11:231
2857699823,38cyclictest7015-21/usr/sbin/munin09:01:091
2857699823,36cyclictest18452-21ssh12:00:461
2857699823,36cyclictest18452-21ssh12:00:461
2857699823,28cyclictest20052-21grep09:21:221
2857699822,36cyclictest17002-21wc09:16:221
28584998162,13cyclictest1-21systemd07:05:462
28584998162,12cyclictest298-21in:imuxsock09:59:182
2858499813,26cyclictest13366-21apt-get07:45:582
2858499813,24cyclictest30332-21fschecks_time11:26:082
2858499813,24cyclictest30332-21fschecks_time11:26:082
2858499812,38cyclictest28335-21taskset12:16:162
2858499812,38cyclictest28335-21taskset12:16:162
2858499812,37cyclictest25797-21sshd11:18:182
2858499812,37cyclictest25797-21sshd11:18:182
2858499812,35cyclictest17631-21idleruntime10:11:092
2857699813,23cyclictest5247-21apt-get09:51:141
2857699813,23cyclictest14707-21modprobe07:50:441
2857699813,22cyclictest29724-21/usr/sbin/munin06:56:231
2857699813,12cyclictest0-21swapper/110:06:271
2857699812,36cyclictest28217-21/usr/sbin/munin12:16:121
2857699812,36cyclictest28217-21/usr/sbin/munin12:16:121
2857699812,34cyclictest352-21runrttasks07:11:041
2857699812,34cyclictest3341-21wc11:35:471
2858499804,24cyclictest22071-21apt-config09:25:492
28584998040,33cyclictest32742-21kworker/u17:1-nfsiod09:45:172
2858499803,35cyclictest3394-21ssh10:41:142
2858499803,33cyclictest8703-21ssh11:44:262
2858499803,22cyclictest3986-21/usr/sbin/munin11:36:132
2858499802,37cyclictest21720-21/usr/sbin/munin12:06:152
28576998060,14cyclictest11085-21ntpd11:41:191
28576998058,14cyclictest2374-21systemd-journal11:07:181
28576998058,14cyclictest2374-21systemd-journal11:07:181
28576998057,14cyclictest2374-21systemd-journal12:07:181
2857699804,36cyclictest3518-21/usr/sbin/munin11:36:061
2857699803,34cyclictest10598-21nfs4_client07:36:141
2857699802,36cyclictest31458-21/usr/sbin/munin08:41:111
2858499799,28cyclictest2053-21diskmemload09:46:002
2858499799,28cyclictest2053-21diskmemload09:46:002
2858499794,21cyclictest8476-21modprobe10:50:442
28584997939,33cyclictest27886-21acpi08:30:542
2858499793,27cyclictest28793-21uniq09:36:112
2858499793,27cyclictest28793-21uniq09:36:112
2858499793,26cyclictest18771-21cat11:06:212
2858499793,26cyclictest18771-21cat11:06:212
2858499793,25cyclictest15723-21/usr/sbin/munin11:56:032
2858499793,25cyclictest15723-21/usr/sbin/munin11:56:032
2858499793,20cyclictest19527-21cron08:05:452
2858499793,20cyclictest19527-21cron08:05:452
2858499793,11cyclictest0-21swapper/210:40:032
2858499792,37cyclictest29728-21unin-run11:25:452
28584997911,21cyclictest6041-21wc07:21:202
28584997911,21cyclictest6041-21wc07:21:202
28576997935,38cyclictest0-21swapper/107:06:431
2857699793,36cyclictest31273-21/usr/sbin/munin07:01:271
2857699793,29cyclictest28171-21latency_hist09:35:461
28576997931,41cyclictest0-21swapper/110:20:571
2857699792,36cyclictest27532-21latency_hist12:15:471
2858499783,34cyclictest352-21runrttasks08:51:012
2858499783,33cyclictest16816-21mailstats09:16:202
2858499783,26cyclictest29725-21taskset06:56:232
2858499782,36cyclictest9855-21apt07:35:452
2857699783,35cyclictest32669-21/usr/sbin/munin10:36:111
2857699783,33cyclictest11933-21cstates10:56:021
2857699782,37cyclictest30034-21ssh11:26:001
2857699782,37cyclictest30034-21ssh11:26:001
28576997822,42cyclictest0-21swapper/110:51:051
28576997822,42cyclictest0-21swapper/110:51:051
28576997813,28cyclictest11581-21diskmemload10:01:081
28576997813,26cyclictest4379-21sensors_temp08:56:201
2858499773,37cyclictest14289-21ssh10:05:572
2858499773,27cyclictest27036-21runrttasks12:14:472
2858499773,22cyclictest352-21runrttasks08:21:162
2858499773,21cyclictest438-21apt-get07:06:162
28584997726,45cyclictest0-21swapper/211:50:522
2857699776,65cyclictest0-21swapper/110:41:081
2857699774,35cyclictest26418-21cstates10:26:011
2857699774,35cyclictest26418-21cstates10:26:011
28576997735,37cyclictest0-21swapper/109:45:471
2857699773,39cyclictest6612-21latency_hist07:25:541
2857699773,39cyclictest6612-21latency_hist07:25:541
2857699773,33cyclictest19447-21ssh10:14:211
28576997731,39cyclictest0-21swapper/108:06:101
2857699772,37cyclictest3254-21latency_hist08:55:491
28584997654,12cyclictest0-21swapper/210:26:002
28584997654,12cyclictest0-21swapper/210:26:002
2858499763,26cyclictest11926-21/usr/sbin/munin07:41:092
2858499763,25cyclictest30466-21unixbench_singl08:36:212
2858499763,25cyclictest26918-21sendmail_mailst08:26:182
2858499763,25cyclictest26918-21sendmail_mailst08:26:182
2858499763,23cyclictest4168-21/usr/sbin/munin07:16:132
2858499763,11cyclictest0-21swapper/208:48:042
28576997641,30cyclictest28553-21cyclictest10:32:441
2857699763,8cyclictest0-21swapper/109:55:491
2857699763,32cyclictest21181-21/usr/sbin/munin11:11:081
2857699763,25cyclictest24508-21latency_hist08:20:471
2857699763,24cyclictest14908-21/usr/sbin/munin11:01:021
2857699762,22cyclictest16743-21/usr/sbin/munin07:56:051
28564997659,11cyclictest23846-21ntp_kernel_pll_10:21:140
2858499753,24cyclictest22782-21latency_hist08:15:442
2858499752,24cyclictest23502-21/usr/sbin/munin08:16:132
2858499752,21cyclictest15269-21/usr/sbin/munin07:51:122
28576997554,14cyclictest2374-21systemd-journal07:45:181
2857699753,25cyclictest26982-21/usr/sbin/munin08:26:191
2857699753,25cyclictest26982-21/usr/sbin/munin08:26:191
2857699753,23cyclictest24914-21fschecks_time08:21:081
28576997530,38cyclictest0-21swapper/107:51:061
2858499744,24cyclictest20242-21latency08:06:122
2858499744,22cyclictest352-21runrttasks07:55:522
2857699742,25cyclictest433-21/usr/sbin/munin08:46:031
2856499746,27cyclictest31021-21apt-get07:01:040
2857699737,60cyclictest0-21swapper/107:28:371
28564997354,13cyclictest5690-21sh11:39:220
28564997354,12cyclictest12731-21/usr/sbin/munin11:51:050
2856499694,51cyclictest13847-21processes09:11:330
28564996944,18cyclictest17796-21ssh09:18:140
28564996851,11cyclictest32479-21systemctl08:45:440
2856499682,52cyclictest20098-21fschecks_time08:06:090
28564996748,13cyclictest7559-21unixbench_singl11:41:220
28564996651,9cyclictest8514-21kworker/u17:4+rpciod10:56:510
28564996632,24cyclictest0-21swapper/012:06:180
28564996550,8cyclictest0-21swapper/012:01:210
28564996549,9cyclictest0-21swapper/010:51:020
28564996549,9cyclictest0-21swapper/010:51:020
28564996452,7cyclictest0-21swapper/008:01:010
28564996452,7cyclictest0-21swapper/008:01:010
2856499643,32cyclictest6655-21sendmail-msp07:25:450
2856499643,32cyclictest6655-21sendmail-msp07:25:450
2785926410,27sleep30-21swapper/306:51:333
2858999639,33cyclictest0-21swapper/311:46:163
2858999632,48cyclictest450-21taskset07:06:053
2858999632,45cyclictest15008-21taskset10:06:193
2858999625,41cyclictest20602-21taskset10:16:083
2858999625,41cyclictest20602-21taskset10:16:083
2858999624,42cyclictest25950-21chrt10:25:443
28564996247,10cyclictest28553-21cyclictest08:51:190
28564996135,20cyclictest9862-21kworker/u17:0+nfsiod10:43:110
2858999603,40cyclictest9852-21taskset09:05:593
2858999603,34cyclictest0-21swapper/309:11:073
2856499603,45cyclictest16441-21grep07:55:470
2856499603,31cyclictest1908-21latency_hist07:10:470
2858999596,33cyclictest0-21swapper/311:15:583
2858999596,33cyclictest0-21swapper/311:15:583
2858999595,39cyclictest17031-21chrt07:56:113
28564995940,13cyclictest4989-21cron07:20:450
2858999585,31cyclictest0-21swapper/309:31:203
2858999583,42cyclictest18850-21taskset08:01:183
2858999583,42cyclictest18850-21taskset08:01:183
2856499584,32cyclictest2968-21unixbench_multi07:11:210
2856499583,32cyclictest544-21cron08:50:450
2858999574,37cyclictest634-21taskset11:31:013
2858999573,42cyclictest19904-21taskset08:06:033
2858999573,39cyclictest5094-21taskset07:20:473
2858999573,39cyclictest31187-21taskset09:40:453
2858999573,39cyclictest31187-21taskset09:40:453
2858999573,31cyclictest0-21swapper/309:26:193
28589995713,31cyclictest310432sleep312:21:373
2858999564,38cyclictest32505-21taskset08:45:453
2858999563,36cyclictest15385-21chrt11:01:143
2858999563,35cyclictest1933-21chrt09:45:483
2856499564,29cyclictest24434-21latency_hist08:20:460
2856499563,44cyclictest29561-21cpu08:36:010
2856499563,38cyclictest6757-21/usr/sbin/munin07:26:090
2858999553,37cyclictest28243-21chrt12:16:123
2858999553,37cyclictest28243-21chrt12:16:123
2858999544,36cyclictest28388-21chrt08:31:113
2858999544,31cyclictest0-21swapper/309:51:043
2858999543,39cyclictest6868-21chrt07:25:583
2858999543,39cyclictest6868-21chrt07:25:583
2858999543,35cyclictest2556-21chrt09:46:133
2858999543,35cyclictest2556-21chrt09:46:133
2858999542,40cyclictest8337-21chrt09:03:113
2858999542,35cyclictest10981-21chrt07:36:233
2856499544,35cyclictest26272-21/usr/sbin/munin08:26:200
2856499544,35cyclictest26272-21/usr/sbin/munin08:26:200
2858999534,35cyclictest28893-21taskset06:56:043
2858999533,39cyclictest2308-21chrt10:40:193
2858999533,38cyclictest16364-21chrt07:55:473
2858999533,37cyclictest2792-21chrt10:40:563
2858999533,35cyclictest28194-21taskset10:28:403
2858999533,35cyclictest28194-21taskset10:28:403
2858999533,35cyclictest25732-21chrt12:11:223
2858999533,35cyclictest14182-21taskset07:46:233
2858999533,34cyclictest8502-21chrt07:30:563
2858999532,39cyclictest20932-21taskset09:23:383
2858999524,35cyclictest7253-21chrt11:41:193
2858999523,39cyclictest30921-21taskset08:40:473
2858999523,37cyclictest22942-21chrt08:15:473
2858999523,36cyclictest11572-21chrt10:55:473
2858999523,36cyclictest11572-21chrt10:55:473
2858999523,35cyclictest16408-21taskset11:56:183
2858999523,35cyclictest16408-21taskset11:56:183
2858999522,33cyclictest26995-21taskset11:20:563
2858999522,32cyclictest3524-21chrt08:55:493
2858999513,35cyclictest30775-21chrt07:00:543
2858999513,35cyclictest25249-21chrt08:21:183
2858999513,35cyclictest13965-21chrt11:51:403
2858999513,33cyclictest1710-21chrt08:50:473
2858999504,36cyclictest29893-21chrt10:31:153
2858999504,33cyclictest20113-21taskset10:15:473
2858999503,36cyclictest6047-21taskset10:46:073
2858999503,35cyclictest2044-21taskset08:51:033
2858999502,34cyclictest12865-21taskset10:02:463
2858999494,34cyclictest20775-21chrt11:10:553
2858999493,35cyclictest7689-21taskset07:26:183
2858999493,33cyclictest11769-21taskset10:55:553
2858999484,35cyclictest19481-21chrt11:07:593
2858999484,35cyclictest19481-21chrt11:07:593
2858999483,36cyclictest9449-21taskset09:56:383
2858999483,33cyclictest3420-21chrt07:15:453
2858999483,31cyclictest3612-21chrt11:36:043
2858999483,31cyclictest26616-21chrt08:26:083
2858999483,31cyclictest26616-21chrt08:26:083
2858999482,37cyclictest17295-21chrt09:16:493
2858999463,32cyclictest23173-21chrt08:16:043
2858999462,31cyclictest23869-21chrt12:09:153
2858999462,31cyclictest19054-21chrt12:01:093
2858999442,29cyclictest31654-21chrt11:27:533
2858999442,29cyclictest31654-21chrt11:27:533
2858999393,25cyclictest11735-21chrt07:41:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional