You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 08:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Thu Jul 23, 2026 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22733210510,66sleep222217-21apt-get18:51:492
24211991043,65cyclictest31018-21apt-get22:46:421
24219991013,69cyclictest31588-21apt-get22:46:472
242199910057,37cyclictest0-21swapper/220:57:022
24219991003,35cyclictest6102-21apt-get22:01:372
24223999810,69cyclictest26624-21chrt21:41:443
24219999772,19cyclictest28376-21cpu22:41:432
24211999739,51cyclictest0-21swapper/121:16:321
24211999737,8cyclictest0-21swapper/100:06:411
24211999737,8cyclictest0-21swapper/100:06:411
2314629731,37sleep123216-21latency18:52:551
2421999962,62cyclictest20373-21apt-get21:31:432
2421199963,32cyclictest4587-21cron21:06:271
2421199963,32cyclictest4587-21cron21:06:271
2421199952,35cyclictest1305-21grep19:22:051
2421999943,19cyclictest26128-21/usr/sbin/munin22:37:022
24211999449,38cyclictest1153-21unixbench_multi21:52:041
2421199943,32cyclictest14578-21kernelversion21:21:541
24219999346,40cyclictest10618-21latency_hist21:16:302
2421199935,63cyclictest11178-21apt-get21:16:461
2421199935,63cyclictest11178-21apt-get21:16:461
24211999339,47cyclictest0-21swapper/120:56:311
24211999339,47cyclictest0-21swapper/120:56:311
24211999338,48cyclictest31814-21fschecks_count20:57:211
2421199933,36cyclictest29837-21uniq21:46:491
2421199932,43cyclictest30837-21diskmemload00:23:221
24219999256,24cyclictest14351-21grep23:11:512
24219999238,47cyclictest0-21swapper/221:51:442
24211999236,12cyclictest0-21swapper/123:41:281
24211999234,14cyclictest0-21swapper/100:16:541
24211999234,14cyclictest0-21swapper/100:16:541
2421199923,40cyclictest2989-21wc22:52:021
2421199923,40cyclictest2989-21wc22:52:021
2421199923,37cyclictest19371-21/usr/sbin/munin22:26:481
2421199922,44cyclictest28077-21cpu19:06:441
2421199922,33cyclictest20022-21/usr/sbin/munin23:21:441
2421199914,33cyclictest11498-21latency_hist19:56:301
2421199912,38cyclictest26615-21ssh21:41:421
2421999902,32cyclictest19815-21latency_hist23:21:302
2421999902,32cyclictest19815-21latency_hist23:21:302
2421199906,68cyclictest32334-21ssh23:41:561
2421199906,68cyclictest32334-21ssh23:41:561
2421199903,40cyclictest3109-21/usr/sbin/munin21:56:501
2421199903,38cyclictest26025-21/usr/sbin/munin23:32:011
2421199903,38cyclictest13098-21timerwakeupswit22:12:051
2421199903,35cyclictest11078-21/usr/sbin/munin23:06:531
24211999032,8cyclictest0-21swapper/120:01:491
2421199902,37cyclictest23037-21/usr/sbin/munin23:27:051
2421199902,35cyclictest9798-21pluginstate22:07:001
2421199902,35cyclictest9798-21pluginstate22:07:001
2421199902,35cyclictest19859-21latency_hist23:21:301
2421199902,35cyclictest19859-21latency_hist23:21:301
24202999066,17cyclictest941-21ssh23:43:060
24202999066,17cyclictest941-21ssh23:43:060
24219998958,21cyclictest19522-21idleruntime-cro20:21:272
2421999892,33cyclictest17337-21ntp_kernel_pll_00:11:542
24219998912,26cyclictest24832-21cut20:36:522
24219998912,26cyclictest24832-21cut20:36:522
2421199893,36cyclictest5717-21grep21:07:021
2421199893,34cyclictest6082-21/usr/sbin/munin22:01:551
2421199893,30cyclictest27045-21timerandwakeup20:42:041
2421199893,24cyclictest28129-21fschecks_time20:46:491
2421199892,33cyclictest8282-21taskset23:01:491
24219998838,42cyclictest0-21swapper/221:41:302
2421999883,32cyclictest1910-21/usr/sbin/munin21:01:392
2421999883,32cyclictest1910-21/usr/sbin/munin21:01:392
2421999883,31cyclictest31078-21latency_hist19:16:302
2421999882,34cyclictest11462-21ssh21:17:272
2421999882,34cyclictest11462-21ssh21:17:272
2421199884,34cyclictest17137-21/usr/sbin/munin21:27:051
2421199884,34cyclictest17137-21/usr/sbin/munin21:27:051
2421199883,37cyclictest17149-21cat00:11:491
2421199883,34cyclictest8747-21fschecks_time19:46:491
2421199883,31cyclictest18026-21latency_hist20:16:301
2421199882,35cyclictest30483-21grep19:12:021
2421199882,33cyclictest352-21runrttasks20:31:401
24219998738,41cyclictest0-21swapper/223:22:372
24219998737,42cyclictest30837-21diskmemload23:06:322
2421999873,33cyclictest20033-21grep00:16:492
2421999873,33cyclictest20033-21grep00:16:492
24219998726,53cyclictest0-21swapper/223:41:582
24219998726,53cyclictest0-21swapper/223:41:582
2421999872,34cyclictest3051-21timerwakeupswit22:52:032
2421999872,34cyclictest3051-21timerwakeupswit22:52:032
2421199874,32cyclictest3888-21fschecks_time19:31:511
2421199874,32cyclictest3888-21fschecks_time19:31:511
2421199873,35cyclictest5215-21cstates22:56:441
2421199873,33cyclictest11944-21fschecks_time19:56:501
24211998722,13cyclictest0-21swapper/121:41:311
24211998719,17cyclictest11619-21unixbench_multi00:02:021
2299228711,45sleep023021-21fschecks_time18:52:490
2421999864,33cyclictest17221-21cut20:12:022
2421999863,54cyclictest13287-21apt-get00:06:522
2421999863,54cyclictest13287-21apt-get00:06:522
2421999863,35cyclictest27395-21ssh21:42:512
2421999863,31cyclictest23483-21tr23:26:542
24219998619,20cyclictest12028-21latency_hist22:11:312
24219998619,20cyclictest12028-21latency_hist22:11:312
24211998634,7cyclictest0-21swapper/120:31:301
2421199863,38cyclictest19964-21fschecks_count20:21:501
2421199863,34cyclictest14681-21ntp_offset23:11:581
2421199862,36cyclictest2988-21head19:27:051
2421199862,36cyclictest2988-21head19:27:051
2421199862,35cyclictest19190-21latency_hist22:26:301
2421199862,34cyclictest19013-21ls20:17:041
2421199862,31cyclictest7658-21timerandwakeup19:42:041
24202998670,9cyclictest11963-21latency_hist22:11:300
24202998670,9cyclictest11963-21latency_hist22:11:300
24202998665,14cyclictest5891-21latency_hist22:01:300
2421999854,31cyclictest8280-21latency_hist23:56:302
24219998536,41cyclictest0-21swapper/200:01:472
2421999853,33cyclictest15067-21cstates20:06:432
2421999853,31cyclictest3214-21uname23:46:522
2421999853,31cyclictest29773-21fschecks_time20:51:562
2421999853,31cyclictest29773-21fschecks_time20:51:562
2421999853,30cyclictest29408-21if_eth023:36:512
2421999853,28cyclictest8279-21latency_hist19:46:292
24219998525,10cyclictest0-21swapper/200:21:532
2421999852,33cyclictest4980-21cpu21:06:452
2421999852,33cyclictest31747-21ntp_kernel_err19:16:552
2421199853,30cyclictest9384-21ssh23:58:551
2421199853,30cyclictest5506-21fschecks_time19:36:491
2421199853,29cyclictest28095-21latency_hist22:41:291
2421199852,37cyclictest26223-21timerandwakeup19:01:371
2421199852,33cyclictest22371-21/usr/sbin/munin22:32:001
2421199852,33cyclictest22371-21/usr/sbin/munin22:32:001
2421999844,31cyclictest28880-21latency_hist23:36:302
2421999843,31cyclictest29442-21latency_hist19:11:302
2421999843,31cyclictest24656-21tune2fs18:56:502
2421999843,30cyclictest10739-21cron23:06:272
2421999842,25cyclictest26613-21fschecks_count19:01:512
24211998425,10cyclictest0-21swapper/120:06:541
2421199842,38cyclictest3852-21grep23:47:041
2421199842,34cyclictest20989-21fschecks_time21:32:401
24202998469,10cyclictest24189-21cyclictest20:57:350
2421999834,30cyclictest17137-21/usr/sbin/munin21:26:382
2421999834,30cyclictest17137-21/usr/sbin/munin21:26:382
2421999833,34cyclictest14972-21latency_hist22:16:302
2421999833,33cyclictest9962-21latency_hist19:51:302
2421999833,33cyclictest2290-21fschecks_time19:26:502
2421999833,33cyclictest2290-21fschecks_time19:26:502
2421999833,31cyclictest15421-21sh22:16:542
2421999833,28cyclictest601-21fschecks_count19:21:502
24219998332,43cyclictest0-21swapper/220:01:522
24219998329,47cyclictest0-21swapper/222:32:032
24219998329,47cyclictest0-21swapper/222:32:032
24219998329,45cyclictest0-21swapper/219:57:012
24219998328,46cyclictest0-21swapper/220:44:222
2421999832,31cyclictest22246-21timerwakeupswit20:27:032
2421999832,31cyclictest19966-21cut20:21:502
24219998316,21cyclictest277-21dbus-daemon20:36:302
2421199834,32cyclictest31248-21/usr/sbin/munin19:17:001
2421199832,34cyclictest24628-21/usr/sbin/munin20:37:031
2421199832,34cyclictest24628-21/usr/sbin/munin20:37:031
24202998363,14cyclictest29334-21fschecks_time23:36:500
2421999823,31cyclictest29213-21cron20:51:272
2421999823,31cyclictest14154-21/usr/sbin/munin21:21:392
2421999822,33cyclictest5080-21acpi22:56:372
24219998221,8cyclictest0-21swapper/221:56:512
24202998268,8cyclictest0-21swapper/020:16:270
2422399815,33cyclictest0-21swapper/322:46:453
2422399813,40cyclictest0-21swapper/321:32:293
2421999813,33cyclictest29871-21fschecks_time21:46:492
2421999813,25cyclictest19256-21latency_hist22:26:312
2421999812,27cyclictest10731-21wc19:52:012
24219998116,22cyclictest5247-21acpi19:36:382
2420299813,56cyclictest16748-21/usr/sbin/munin00:11:570
2421999803,33cyclictest10425-21latency_hist00:01:302
2421999803,29cyclictest19683-21tune2fs22:26:472
24202998060,14cyclictest11618-21sh21:17:310
24202998060,14cyclictest11618-21sh21:17:310
24202998057,15cyclictest14887-21sh00:08:110
24202998057,15cyclictest14887-21sh00:08:110
2422399798,48cyclictest0-21swapper/323:41:453
2422399798,48cyclictest0-21swapper/323:41:453
2421199795,52cyclictest15371-21modprobe22:16:451
24202997959,12cyclictest1-21systemd00:06:280
2421999783,31cyclictest3718-21cpuspeed19:31:462
2421999783,31cyclictest3718-21cpuspeed19:31:462
24202997863,8cyclictest0-21swapper/020:06:310
24202997860,12cyclictest30837-21diskmemload21:26:490
24202997860,12cyclictest30837-21diskmemload21:26:490
24202997841,17cyclictest181rcu_preempt20:26:510
2422399773,45cyclictest0-21swapper/320:56:533
24202997761,10cyclictest4995-21latency_hist19:36:300
24202997761,10cyclictest4995-21latency_hist19:36:300
2420299775,38cyclictest20671-21sort00:17:030
2420299775,38cyclictest20671-21sort00:17:030
24202997744,11cyclictest181rcu_preempt20:43:320
24202997739,17cyclictest181rcu_preempt20:32:420
24202997662,9cyclictest30549-21kworker/u17:3+rpciod23:51:550
24202997646,21cyclictest6694-21grep22:01:550
24202997643,24cyclictest638-21grep19:21:500
24202997640,11cyclictest181rcu_preempt19:10:480
24202997637,9cyclictest181rcu_preempt23:09:100
24202997619,43cyclictest3063-21fschecks_time23:46:480
24202997559,10cyclictest24372-21ssh23:27:400
24202997558,11cyclictest24189-21cyclictest21:45:120
24202997557,12cyclictest31303-21sh21:48:460
24202997554,15cyclictest10625-21idleruntime-cro21:16:270
24202997552,17cyclictest23025-21sh00:21:520
24202997536,10cyclictest181rcu_preempt22:40:000
2420299746,59cyclictest20373-21apt-get21:31:480
24202997456,12cyclictest1864-21ssh21:53:510
24202997455,13cyclictest29856-21kernelversion20:51:590
24202997455,13cyclictest29856-21kernelversion20:51:590
24202997450,10cyclictest181rcu_preempt21:26:160
24202997352,14cyclictest21276-21latency_hist20:26:300
2420299734,38cyclictest26762-21sendmail_mailst23:32:010
24202997336,30cyclictest0-21swapper/023:22:010
24202997327,30cyclictest181rcu_preempt21:36:500
2422399722,53cyclictest31740-21taskset23:41:283
2420299725,33cyclictest15-21ksoftirqd/018:56:420
24202997250,9cyclictest181rcu_preempt22:51:010
24202997239,12cyclictest181rcu_preempt22:58:060
24202997232,12cyclictest181rcu_preempt22:11:510
24202997158,9cyclictest58-21kcompactd020:46:470
24202997141,21cyclictest30384-21grep19:12:010
24202997138,26cyclictest0-21swapper/022:54:190
24202997138,26cyclictest0-21swapper/022:54:190
2422399702,53cyclictest23981-21chrt20:32:013
24202997054,10cyclictest22992-21ntp_offset22:31:570
24202997054,10cyclictest22992-21ntp_offset22:31:570
24202997052,12cyclictest31483-21apt-key22:46:320
24202997049,14cyclictest4923-21/usr/sbin/munin21:07:040
24202997048,8cyclictest181rcu_preempt23:03:270
24202997037,10cyclictest181rcu_preempt19:01:380
24202997035,12cyclictest181rcu_preempt22:19:560
2420299703,38cyclictest19654-21fschecks_count22:26:470
2422399693,50cyclictest21343-21taskset22:29:263
2422399692,53cyclictest27699-21chrt23:33:383
2422399692,53cyclictest24724-21taskset23:28:403
24202996955,10cyclictest24189-21cyclictest21:05:190
24202996955,10cyclictest24189-21cyclictest21:05:190
24202996953,11cyclictest24189-21cyclictest19:57:270
24202996948,8cyclictest181rcu_preempt19:46:520
24202996930,12cyclictest0-21swapper/020:11:310
2422399687,50cyclictest0-21swapper/321:16:483
2422399687,50cyclictest0-21swapper/321:16:483
2422399683,51cyclictest27910-21chrt22:41:103
24211996851,10cyclictest31372-21ssh22:46:321
2420299683,37cyclictest10340-21latency_hist00:01:290
2422399673,51cyclictest24445-21taskset00:23:563
2422399672,51cyclictest17701-21taskset20:13:553
2422399672,50cyclictest7128-21taskset22:59:423
2422399672,50cyclictest609-21chrt19:21:503
2422399672,50cyclictest24767-21chrt21:37:553
2422399672,50cyclictest15485-21chrt00:08:403
2422399672,50cyclictest15485-21chrt00:08:403
24211996746,12cyclictest24735-21kernelversion18:56:531
24211996742,17cyclictest5777-21/usr/sbin/munin23:51:581
24202996746,8cyclictest181rcu_preempt23:16:570
24202996746,8cyclictest181rcu_preempt23:16:570
24202996743,9cyclictest181rcu_preempt22:23:340
24202996731,16cyclictest181rcu_preempt19:39:360
2280326719,30sleep30-21swapper/318:52:403
2422399663,48cyclictest28999-21taskset20:48:423
2422399663,48cyclictest24893-21chrt22:36:033
2422399663,48cyclictest24893-21chrt22:36:033
2422399663,47cyclictest22705-21taskset20:30:563
2422399662,51cyclictest20672-21chrt23:21:593
2422399662,50cyclictest25489-21taskset18:58:413
2422399662,50cyclictest18543-21taskset00:13:593
24202996649,12cyclictest58-21kcompactd019:31:120
24202996649,12cyclictest58-21kcompactd019:31:120
2420299663,52cyclictest19676-21snmpd23:11:540
2420299663,46cyclictest302-21latency_hist19:21:310
24202996621,34cyclictest18435-21tune2fs20:16:510
2422399653,49cyclictest8895-21taskset23:57:333
2422399653,48cyclictest19273-21chrt20:18:243
2422399653,47cyclictest9673-21taskset21:13:513
2422399652,49cyclictest6540-21taskset21:08:283
24202996522,34cyclictest25418-21timerandwakeup20:37:060
24202996522,34cyclictest25418-21timerandwakeup20:37:060
2422399643,48cyclictest15716-21taskset23:13:363
2422399642,48cyclictest25665-21taskset20:37:323
2422399642,48cyclictest25665-21taskset20:37:323
2420299643,44cyclictest10099-21/usr/sbin/munin19:52:000
2422399633,47cyclictest12215-21chrt00:03:293
2422399633,46cyclictest26416-21taskset19:01:413
2422399633,46cyclictest12755-21chrt19:57:393
2422399633,45cyclictest32555-21chrt19:21:013
2422399633,45cyclictest3129-21chrt19:28:143
2422399633,45cyclictest3129-21chrt19:28:143
2422399632,49cyclictest19212-21chrt22:26:303
2422399632,48cyclictest29843-21taskset20:51:583
2422399632,48cyclictest29843-21taskset20:51:583
2422399632,47cyclictest7876-21chrt19:42:203
2422399632,47cyclictest6528-21taskset19:40:413
2422399632,47cyclictest4000-21chrt23:47:203
2422399632,47cyclictest30196-21chrt19:11:583
2422399632,47cyclictest10319-21taskset22:07:173
2422399632,47cyclictest10319-21taskset22:07:173
24202996338,9cyclictest181rcu_preempt19:42:040
2422399623,46cyclictest8688-21taskset22:06:123
2422399623,46cyclictest11129-21chrt23:06:433
2422399623,46cyclictest10098-21chrt19:51:393
2422399623,45cyclictest14358-21chrt21:21:493
2422399623,45cyclictest0-21swapper/300:16:393
2422399623,45cyclictest0-21swapper/300:16:393
2422399623,44cyclictest14443-21chrt20:03:383
2422399622,47cyclictest4712-21chrt22:56:183
2422399622,47cyclictest4712-21chrt22:56:183
2422399622,47cyclictest4443-21chrt21:57:413
2422399622,47cyclictest32561-21chrt21:51:373
2422399622,46cyclictest28031-21chrt19:06:353
2422399622,46cyclictest18761-21taskset21:28:303
2422399622,46cyclictest18761-21taskset21:28:303
2422399622,46cyclictest16049-21taskset20:08:163
24223996212,32cyclictest0-21swapper/322:16:423
2422399612,46cyclictest5812-21chrt23:51:423
2422399612,46cyclictest4679-21chrt19:32:313
2422399612,46cyclictest4679-21chrt19:32:313
2422399612,46cyclictest31094-21chrt22:46:293
2422399612,45cyclictest8433-21chrt23:01:533
2422399612,44cyclictest9503-21chrt19:47:143
2422399602,45cyclictest27548-21chrt20:46:113
2422399602,44cyclictest13924-21chrt22:14:023
2422399593,44cyclictest19195-21chrt23:20:003
2422399593,44cyclictest19195-21chrt23:20:003
2422399592,46cyclictest19801-21chrt20:21:453
2422399592,44cyclictest3723-21chrt21:04:023
2422399592,44cyclictest3723-21chrt21:04:023
2422399584,41cyclictest30450-21chrt21:47:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional