You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-23 - 00:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Fri May 22, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
143269913470,58cyclictest21453-21diskmemload09:16:510
14332991313,86cyclictest23924-21ssh11:45:551
143269912860,11cyclictest0-21swapper/009:35:430
143329911743,37cyclictest0-21swapper/108:10:411
143329911183,22cyclictest0-21swapper/109:40:591
143399910856,10cyclictest17866-21sh11:35:542
143329910810,79cyclictest13395-21apt-get08:36:111
14332991043,28cyclictest25941-21seq07:35:271
14332991043,28cyclictest25941-21seq07:35:271
143399910042,21cyclictest5235-21cut09:26:382
143399910042,21cyclictest5235-21cut09:26:382
143329910030,37cyclictest0-21swapper/110:35:541
1362229918,40sleep10-21swapper/106:56:261
1362229918,40sleep10-21swapper/106:56:261
14332999835,39cyclictest0-21swapper/111:22:341
14326999876,15cyclictest14314-21cyclictest09:06:050
1320429618,47sleep30-21swapper/306:56:113
1320429618,47sleep30-21swapper/306:56:113
1433299952,29cyclictest352-21runrttasks08:42:581
14332999519,59cyclictest30963-21apt-get09:15:561
1433299947,62cyclictest32371-21ssh10:11:021
14326999459,7cyclictest181rcu_preempt11:49:140
14326999370,17cyclictest544-21cron07:50:390
1433299923,33cyclictest880-21/usr/sbin/munin12:01:071
14326999261,9cyclictest2490-21kworker/u17:410:15:390
14332999142,43cyclictest23339-21latency_hist11:45:411
14326999170,7cyclictest181rcu_preempt11:40:590
14326999165,12cyclictest0-21swapper/008:26:020
14326999165,12cyclictest0-21swapper/008:26:020
14339999075,8cyclictest0-21swapper/207:56:172
14339999067,10cyclictest0-21swapper/208:20:432
14332999051,33cyclictest5012-21sh09:26:281
14332999051,33cyclictest5012-21sh09:26:281
1433299903,30cyclictest26705-21/usr/sbin/munin10:01:071
14326999062,20cyclictest11686-21latency_hist11:25:410
14326999050,30cyclictest0-21swapper/009:50:420
14339998969,9cyclictest0-21swapper/207:41:052
14339998964,15cyclictest14314-21cyclictest09:16:392
1433299893,7cyclictest0-21swapper/112:05:531
14326998953,8cyclictest181rcu_preempt07:40:410
14326998953,8cyclictest181rcu_preempt07:40:410
1433299883,70cyclictest0-21swapper/111:35:501
14326998872,8cyclictest0-21swapper/010:41:020
14326998771,10cyclictest28762-21cron10:05:380
14339998663,15cyclictest14314-21cyclictest11:26:022
1433299863,36cyclictest31742-21awk07:51:121
1433299863,35cyclictest850-21expr11:06:141
14326998671,10cyclictest16389-21kworker/u19:1-nfsiod09:05:230
14339998572,9cyclictest14314-21cyclictest10:55:412
14339998572,9cyclictest14314-21cyclictest10:55:412
14339998566,8cyclictest0-21swapper/212:16:142
14339998566,8cyclictest0-21swapper/212:16:142
1433299853,8cyclictest0-21swapper/108:30:511
1433299853,8cyclictest0-21swapper/108:30:511
1433299853,40cyclictest352-21runrttasks10:10:411
1433299853,30cyclictest28791-21unixbench_singl07:41:151
14339998466,9cyclictest0-21swapper/208:21:012
14339998465,9cyclictest0-21swapper/207:36:022
14339998465,9cyclictest0-21swapper/207:36:022
14339998464,9cyclictest0-21swapper/208:55:432
1433299843,7cyclictest0-21swapper/108:56:351
1433299843,36cyclictest18724-21users10:41:161
1433299843,25cyclictest27765-21rm09:10:501
1433299843,25cyclictest27765-21rm09:10:501
1433299842,39cyclictest26436-21latency_hist10:55:421
1433299842,39cyclictest26436-21latency_hist10:55:421
1433299842,39cyclictest26398-21/usr/sbin/munin07:35:591
1433299842,39cyclictest26398-21/usr/sbin/munin07:35:591
1433299842,36cyclictest13677-21apt-key09:40:391
1433299842,32cyclictest10410-21/usr/sbin/munin08:26:081
1433299842,32cyclictest10410-21/usr/sbin/munin08:26:081
14332998418,56cyclictest7378-21apt-get09:30:571
14326998466,9cyclictest0-21swapper/008:45:410
14326998451,25cyclictest0-21swapper/010:31:150
14326998451,25cyclictest0-21swapper/010:31:150
14339998367,10cyclictest0-21swapper/211:55:422
14339998363,10cyclictest0-21swapper/212:15:412
14339998362,9cyclictest0-21swapper/207:10:422
1433299833,7cyclictest0-21swapper/107:05:561
1433299833,6cyclictest0-21swapper/107:55:521
1433299833,57cyclictest0-21swapper/108:04:031
14332998335,40cyclictest0-21swapper/109:01:121
1433299833,29cyclictest1470-21/usr/sbin/munin09:20:591
1433299833,29cyclictest1470-21/usr/sbin/munin09:20:591
1433299833,26cyclictest24447-21ssh09:56:461
1433299832,7cyclictest0-21swapper/108:15:511
1433299832,37cyclictest13273-21ssh12:21:161
1433299832,32cyclictest15888-21grep11:31:171
1433299832,32cyclictest15888-21grep11:31:171
14326998369,9cyclictest0-21swapper/008:11:040
14326998364,9cyclictest0-21swapper/008:01:030
14339998233,9cyclictest181rcu_preempt10:56:162
1433299823,36cyclictest9222-21ssh12:15:491
1433299823,36cyclictest9222-21ssh12:15:491
1433299823,32cyclictest3625-21/usr/sbin/munin11:11:101
1433299823,29cyclictest8661-21ssh11:20:411
1433299823,29cyclictest8661-21ssh11:20:411
1433299822,40cyclictest11886-21ssh10:30:571
1433299822,40cyclictest11886-21ssh10:30:571
1433299822,34cyclictest22020-21/usr/sbin/munin07:21:121
14326998263,9cyclictest0-21swapper/011:51:160
14339998159,16cyclictest544-21cron07:50:392
14339998154,17cyclictest25000-21kworker/u17:2-xprtiod10:10:432
1433299813,6cyclictest0-21swapper/112:25:501
1433299813,6cyclictest0-21swapper/112:25:501
1433299813,35cyclictest277-21dbus-daemon11:05:401
1433299813,31cyclictest10280-21ssh10:27:341
1433299813,29cyclictest17561-21ssh09:46:031
1433299812,38cyclictest17301-21/usr/sbin/munin08:46:121
1433299812,38cyclictest17301-21/usr/sbin/munin08:46:121
1433299812,32cyclictest21033-21sort10:46:041
1433299812,31cyclictest32486-21modprobe12:00:391
1433299812,30cyclictest25467-21grep09:06:121
1347228111,35sleep20-21swapper/206:56:232
1347228111,35sleep20-21swapper/206:56:232
14339998066,10cyclictest14314-21cyclictest11:20:412
14339998066,10cyclictest14314-21cyclictest11:20:412
14339998065,8cyclictest0-21swapper/209:56:132
14339998064,8cyclictest0-21swapper/209:25:422
14339998064,8cyclictest0-21swapper/209:25:422
14339998063,8cyclictest0-21swapper/208:57:012
14339998061,9cyclictest0-21swapper/210:46:042
14339998059,14cyclictest30682-21apt-key09:15:432
14339998059,14cyclictest30682-21apt-key09:15:432
1433299803,6cyclictest0-21swapper/107:45:541
1433299803,35cyclictest20779-21tr09:51:061
1433299803,31cyclictest19720-21apt-config08:55:411
1433299802,36cyclictest13921-21ssh11:29:081
14326998064,10cyclictest11153-21fschecks_count09:36:010
14326998054,19cyclictest0-21swapper/010:46:030
14339997965,10cyclictest14314-21cyclictest09:40:412
14339997964,8cyclictest0-21swapper/208:46:042
14339997964,8cyclictest0-21swapper/208:46:042
14339997963,10cyclictest22229-21ssh09:01:052
14339997958,10cyclictest0-21swapper/207:30:422
14339997958,10cyclictest0-21swapper/207:30:422
1433299793,31cyclictest14656-21/usr/sbin/munin07:00:581
1433299793,31cyclictest14656-21/usr/sbin/munin07:00:581
1433299792,31cyclictest5301-21sort08:11:011
1433299792,30cyclictest8453-21/usr/sbin/munin08:20:571
14326997947,9cyclictest58-21kcompactd011:38:180
14339997863,8cyclictest0-21swapper/207:01:012
14339997863,8cyclictest0-21swapper/207:01:012
14339997857,14cyclictest6035-21fschecks_count10:21:012
14332997840,31cyclictest0-21swapper/110:21:151
1433299783,37cyclictest20068-21tune2fs07:16:001
1433299782,34cyclictest7148-21runrttasks12:11:131
1433299782,33cyclictest5659-21latency_hist10:20:421
1433299782,31cyclictest23758-21/usr/sbin/munin07:26:161
1433299782,31cyclictest23758-21/usr/sbin/munin07:26:161
14326997863,7cyclictest0-21swapper/008:51:150
14326997854,7cyclictest181rcu_preempt11:11:100
14326997850,14cyclictest0-21swapper/010:06:190
14326997810,52cyclictest4243-21timerandwakeup08:06:130
1433299774,31cyclictest28493-21sh10:58:441
1433299773,31cyclictest26862-21/usr/sbin/munin11:50:491
1433299772,28cyclictest19040-21timerwakeupswit07:11:141
14326997754,14cyclictest17677-21latency_hist11:35:430
14326997754,14cyclictest17677-21latency_hist11:35:430
14326997735,12cyclictest0-21swapper/011:27:200
14339997660,10cyclictest12886-21/usr/sbin/munin12:21:112
14339997657,13cyclictest11914-21sh10:31:002
14339997657,13cyclictest11914-21sh10:31:002
14339997656,13cyclictest2374-21systemd-journal12:08:452
14326997662,8cyclictest0-21swapper/011:00:400
14326997660,10cyclictest277-21dbus-daemon12:00:400
14326997660,10cyclictest2423-21ssh11:10:060
14326997634,15cyclictest15-21ksoftirqd/009:50:550
14339997561,8cyclictest0-21swapper/207:21:012
14339997559,9cyclictest0-21swapper/212:01:052
14339997553,8cyclictest181rcu_preempt07:50:562
14326997553,15cyclictest14314-21cyclictest09:21:450
14326997553,15cyclictest14314-21cyclictest09:21:450
14326997553,14cyclictest298-21in:imuxsock08:20:460
14339997457,8cyclictest0-21swapper/208:45:422
14339997457,11cyclictest17484-21systemd-run11:35:402
14339997457,11cyclictest17484-21systemd-run11:35:402
14339997457,11cyclictest170-21jbd2/mmcblk2p2-810:00:592
14339997453,15cyclictest21453-21diskmemload11:40:562
14339997453,11cyclictest0-21swapper/212:26:042
14339997453,11cyclictest0-21swapper/212:26:042
14326997459,8cyclictest0-21swapper/008:00:410
14326997453,14cyclictest544-21cron10:35:430
14326997452,11cyclictest0-21swapper/012:16:070
14326997452,11cyclictest0-21swapper/012:16:070
14339997360,8cyclictest0-21swapper/211:46:052
14339997360,7cyclictest0-21swapper/209:10:412
14339997352,10cyclictest0-21swapper/211:56:172
14339997350,17cyclictest18300-21vmstat09:46:192
14339997350,15cyclictest17582-21sh10:40:452
14339997335,8cyclictest181rcu_preempt11:14:102
14326997359,8cyclictest0-21swapper/007:06:030
14326997358,8cyclictest0-21swapper/010:21:130
14326997356,8cyclictest0-21swapper/012:26:030
14326997356,8cyclictest0-21swapper/012:26:030
14326997350,18cyclictest23164-21/usr/sbin/munin09:55:580
14339997256,11cyclictest0-21swapper/208:30:422
14339997256,11cyclictest0-21swapper/208:30:422
14339997252,10cyclictest0-21swapper/208:31:012
14339997252,10cyclictest0-21swapper/208:31:012
14339997248,15cyclictest0-21swapper/208:36:502
14326997258,9cyclictest16389-21kworker/u19:1-nfsiod11:20:420
14326997258,9cyclictest16389-21kworker/u19:1-nfsiod11:20:420
14326997256,10cyclictest13609-21entropy08:36:350
14326997250,14cyclictest0-21swapper/007:51:080
14339997155,9cyclictest0-21swapper/211:05:552
14339997155,9cyclictest0-21swapper/211:01:122
14339997134,10cyclictest0-21swapper/207:31:042
14339997134,10cyclictest0-21swapper/207:31:042
14339997127,9cyclictest181rcu_preempt10:37:152
14326997157,8cyclictest0-21swapper/010:15:590
14326997154,8cyclictest0-21swapper/010:26:140
14326997154,11cyclictest277-21dbus-daemon11:05:400
14326997151,10cyclictest0-21swapper/009:11:140
14326997151,10cyclictest0-21swapper/009:11:140
14326997142,9cyclictest181rcu_preempt09:28:060
14326997142,9cyclictest181rcu_preempt09:28:060
14326997127,13cyclictest0-21swapper/007:35:420
14326997127,13cyclictest0-21swapper/007:35:420
14339997051,11cyclictest0-21swapper/210:20:422
14339997048,16cyclictest14702-21sh09:41:492
14326997056,7cyclictest0-21swapper/009:42:050
14326997056,10cyclictest14314-21cyclictest12:09:180
14326997055,8cyclictest0-21swapper/007:15:540
14326997052,9cyclictest0-21swapper/012:01:040
14326997028,36cyclictest0-21swapper/007:26:030
14326997028,36cyclictest0-21swapper/007:26:030
14339996955,9cyclictest2582-21latency_hist10:15:422
14339996953,9cyclictest0-21swapper/209:32:072
14326996953,9cyclictest0-21swapper/007:41:120
14326996948,15cyclictest18939-21threads07:11:130
1433999686,53cyclictest19039-21grep07:11:142
14339996852,8cyclictest0-21swapper/210:25:552
14339996842,8cyclictest181rcu_preempt11:22:432
14326996853,10cyclictest0-21swapper/007:05:090
14326996853,10cyclictest0-21swapper/007:05:090
14326996850,9cyclictest0-21swapper/007:25:390
14326996849,9cyclictest0-21swapper/012:24:000
14326996836,13cyclictest58-21kcompactd008:16:140
14326996831,14cyclictest300-21rs:main0
1286026811,36sleep012853-21apt-get06:55:560
1286026811,36sleep012853-21apt-get06:55:560
14326996750,8cyclictest0-21swapper/012:10:550
14326996747,14cyclictest0-21swapper/008:31:010
14326996747,14cyclictest0-21swapper/008:31:010
14326996747,11cyclictest0-21swapper/008:46:040
14326996747,11cyclictest0-21swapper/008:46:040
14339996645,12cyclictest0-21swapper/207:16:112
258672650,7sleep30-21swapper/309:06:193
14339996547,9cyclictest0-21swapper/208:15:392
14326996548,9cyclictest0-21swapper/010:51:210
14326996548,9cyclictest0-21swapper/010:51:210
14339996332,8cyclictest0-21swapper/209:53:312
14339996325,11cyclictest0-21swapper/208:06:132
1434499615,38cyclictest30340-21taskset11:56:053
14339996119,8cyclictest181rcu_preempt08:00:462
1434499603,43cyclictest10775-21chrt11:23:353
1434499603,39cyclictest15011-21taskset11:31:003
1434499603,39cyclictest15011-21taskset11:31:003
1434499583,39cyclictest917-21kworker/3:1+events09:12:283
1434499583,39cyclictest917-21kworker/3:1+events09:12:283
1434499583,37cyclictest5952-21chrt10:20:573
279772570,8sleep30-21swapper/307:40:563
1434499574,37cyclictest30901-21taskset11:02:113
1434499572,41cyclictest28613-21taskset11:53:053
14344995724,11cyclictest0-21swapper/308:55:543
14344995711,33cyclictest28842-21taskset10:59:443
1434499564,36cyclictest26064-21chrt10:00:433
1434499563,38cyclictest24396-21chrt10:51:213
1434499563,38cyclictest24396-21chrt10:51:213
1434499563,36cyclictest12104-21chrt10:31:033
1434499563,36cyclictest12104-21chrt10:31:033
1434499554,35cyclictest5438-21chrt09:26:423
1434499554,35cyclictest5438-21chrt09:26:423
1434499554,34cyclictest10500-21chrt09:35:223
1434499553,38cyclictest917-21kworker/3:1+events12:00:563
1434499552,40cyclictest31348-21taskset07:51:013
1434499552,39cyclictest14857-21taskset12:25:393
1434499544,34cyclictest3657-21chrt11:11:113
1434499543,42cyclictest11307-21chrt09:36:033
1434499543,38cyclictest5559-21chrt10:20:413
1434499543,35cyclictest3854-21chrt08:06:043
1434499543,34cyclictest24592-21chrt09:05:423
1434499543,32cyclictest7366-21chrt08:16:123
1434499534,35cyclictest20436-21chrt10:45:423
1434499534,34cyclictest12369-21chrt08:31:153
1434499534,34cyclictest12369-21chrt08:31:153
1434499534,33cyclictest15916-21chrt07:05:413
1434499534,33cyclictest15916-21chrt07:05:413
1434499533,37cyclictest23980-21chrt11:46:043
1434499533,36cyclictest29514-21chrt07:45:553
1434499533,35cyclictest25168-21taskset07:31:083
1434499533,35cyclictest25168-21taskset07:31:083
1434499533,33cyclictest19837-21chrt07:15:543
1434499523,36cyclictest9173-21chrt10:26:043
1434499523,35cyclictest26793-21chrt07:36:113
1434499523,35cyclictest26793-21chrt07:36:113
1434499523,30cyclictest14254-21chrt09:40:573
1434499522,38cyclictest11365-21chrt12:19:153
1434499522,38cyclictest11365-21chrt12:19:153
1434499522,36cyclictest3456-21chrt09:23:423
1434499522,36cyclictest3456-21chrt09:23:423
14344995219,25cyclictest0-21swapper/310:11:323
1434499513,38cyclictest27490-21chrt10:02:013
1434499513,36cyclictest20339-21chrt11:40:323
14344995129,16cyclictest0-21swapper/309:16:173
1434499503,37cyclictest21525-21chrt09:51:523
1434499503,37cyclictest13505-21chrt11:27:563
1434499503,36cyclictest7975-21chrt12:12:593
1434499503,34cyclictest8305-21chrt08:20:503
1434499503,34cyclictest23380-21chrt11:45:393
1434499503,34cyclictest19812-21chrt09:50:343
1434499502,35cyclictest16880-21chrt12:28:063
1434499502,35cyclictest16880-21chrt12:28:063
1434499493,33cyclictest14961-21chrt08:40:433
1434499483,38cyclictest917-21kworker/3:1+events10:46:033
1434499483,31cyclictest6461-21taskset08:15:393
1434499483,30cyclictest16418-21chrt07:05:493
1434499483,29cyclictest21579-21taskset07:21:003
1434499473,33cyclictest8354-21chrt11:20:063
1434499473,33cyclictest8354-21chrt11:20:063
1434499473,31cyclictest3285-21chrt12:05:493
1434499462,31cyclictest29266-21taskset10:05:583
1434499454,28cyclictest15957-21chrt08:41:153
1434499453,30cyclictest3422-21taskset08:05:433
1434499443,31cyclictest16757-21chrt10:39:053
1434499443,30cyclictest18715-21taskset07:11:083
1434499433,28cyclictest18257-21taskset08:50:513
1434499433,26cyclictest1730-21chrt11:08:073
1434499423,29cyclictest780-21taskset07:56:113
1434499423,28cyclictest10943-21chrt08:26:453
1434499423,28cyclictest10943-21chrt08:26:453
1434499422,27cyclictest17067-21taskset08:46:053
1434499422,27cyclictest17067-21taskset08:46:053
1434499412,28cyclictest23012-21taskset07:25:543
1434499412,28cyclictest23012-21taskset07:25:543
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional