You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 09:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu May 14, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
139559911358,11cyclictest12504-21kworker/u17:2+xprtiod21:46:450
139559911349,19cyclictest13942-21cyclictest00:21:390
139559911349,19cyclictest13942-21cyclictest00:21:390
1378921066,16sleep10-21swapper/119:01:061
12933210432,36sleep20-21swapper/218:56:472
139649910210,67cyclictest7055-21apt-get00:11:301
13964991009,67cyclictest20441-21apt-get22:46:291
13964999730,27cyclictest0-21swapper/121:51:481
1397399952,34cyclictest15297-21fschecks_count20:41:332
13973999337,49cyclictest2374-21systemd-journal20:56:132
1397399933,33cyclictest352-21runrttasks23:56:352
13973999325,11cyclictest0-21swapper/223:30:222
13973999325,11cyclictest0-21swapper/223:30:222
1396499933,67cyclictest30274-21apt-get23:56:401
1397399925,17cyclictest143792cat20:36:502
13955999246,36cyclictest14913-21timerandwakeup19:01:480
1397399913,33cyclictest1199-21grep23:06:502
1397399913,32cyclictest1418-21ntp_kernel_pll_00:01:412
1397399913,22cyclictest22784-21/usr/sbin/munin21:01:512
1397399913,22cyclictest22784-21/usr/sbin/munin21:01:512
13964999140,26cyclictest22381-21sh23:42:251
13964999140,26cyclictest22381-21sh23:42:251
13973999037,45cyclictest0-21swapper/222:47:052
1397399903,31cyclictest6180-21ssh23:16:242
1397399903,31cyclictest6180-21ssh23:16:242
1397399902,36cyclictest18365-21fschecks_count23:36:362
13964999069,11cyclictest15880-21latency_hist00:26:161
13964999069,11cyclictest15880-21latency_hist00:26:161
13955999072,12cyclictest15190-21timerwakeupswit22:36:490
13973998946,37cyclictest14762-21mailstats19:01:462
1397399894,36cyclictest16822-21ssh21:46:242
1397399894,35cyclictest18139-21dpkg20:51:142
13973998940,42cyclictest0-21swapper/222:36:382
1397399893,35cyclictest22568-21latency_hist19:26:162
1397399893,35cyclictest22568-21latency_hist19:26:162
1397399893,35cyclictest10730-21cat21:36:302
1397399893,35cyclictest10730-21cat21:36:302
1397399893,34cyclictest31887-21sh23:05:032
1397399893,33cyclictest23561-21ls22:51:302
1397399893,32cyclictest9701-21cron00:16:122
137312896,65sleep00-21swapper/019:00:200
13973998859,21cyclictest23754-21kworker/u17:1-ext4-rsv-conversion00:11:172
1397399883,37cyclictest27040-21sort23:51:222
1397399883,34cyclictest25970-21users21:06:532
1397399883,34cyclictest1311-21latency_hist21:21:162
1397399883,33cyclictest19345-21latency_hist19:16:162
1397399883,28cyclictest26406-21/usr/sbin/munin22:56:492
1397399882,38cyclictest14336-21ssh21:42:292
1397399882,38cyclictest14336-21ssh21:42:292
1397399876,35cyclictest10003-21sshd00:16:202
1397399874,33cyclictest25924-21latency_hist19:36:152
1397399874,33cyclictest25924-21latency_hist19:36:152
1397399874,32cyclictest352-21runrttasks22:08:162
13973998735,44cyclictest0-21swapper/222:41:332
1397399873,34cyclictest8119-21latency_hist22:26:162
1397399873,33cyclictest15958-21switchtime23:31:472
13973998729,50cyclictest0-21swapper/221:51:482
1397399872,36cyclictest8654-21tune2fs20:21:332
1397399872,36cyclictest8654-21tune2fs20:21:332
1397399872,34cyclictest31232-21grep19:51:362
13955998765,16cyclictest6636-21apt-key00:11:150
1397399864,33cyclictest352-21runrttasks23:49:202
1397399864,33cyclictest352-21runrttasks23:49:202
1397399864,33cyclictest23820-21unixbench_multi19:27:082
1397399864,33cyclictest23820-21unixbench_multi19:27:082
1397399864,32cyclictest19698-21fschecks_time19:16:352
1397399864,31cyclictest10925-21grep20:26:492
1397399864,31cyclictest10925-21grep20:26:492
1397399863,35cyclictest12993-21/usr/sbin/munin00:21:492
1397399863,35cyclictest12993-21/usr/sbin/munin00:21:492
1397399863,34cyclictest352-21runrttasks20:59:492
1397399863,32cyclictest16232-21grep00:26:342
1397399863,31cyclictest4587-21/usr/sbin/munin21:26:482
1397399863,30cyclictest4916-21latency_hist20:11:162
13973998632,46cyclictest0-21swapper/221:16:172
13973998632,46cyclictest0-21swapper/221:16:172
1397399862,39cyclictest11013-21ssh22:31:152
1397399862,39cyclictest11013-21ssh22:31:152
13964998659,20cyclictest528-21kworker/u17:3+events_unbound19:06:131
1397399853,35cyclictest3409-21grep23:11:352
1397399853,35cyclictest12403-21ssh22:31:562
1397399853,34cyclictest29251-21latency_hist19:46:162
1397399853,33cyclictest17098-21grep19:06:512
1397399853,33cyclictest17098-21grep19:06:512
1397399853,32cyclictest13308-21latency_hist20:36:162
1397399853,31cyclictest2905-21grep20:01:492
13973998523,28cyclictest25650-21cat22:01:162
13964998526,23cyclictest17262-21seq19:08:091
13964998526,23cyclictest17262-21seq19:08:091
1397399844,34cyclictest5187-21/usr/sbin/munin20:11:382
1397399843,34cyclictest10367-21latency_hist21:36:152
1397399843,33cyclictest1608-21/usr/sbin/munin21:21:482
1397399843,31cyclictest9111-21/usr/sbin/munin23:21:372
13973998419,14cyclictest0-21swapper/222:16:352
13964998462,16cyclictest13408-21latency_hist21:41:161
13964998462,16cyclictest13408-21latency_hist21:41:161
13964998461,16cyclictest544-21cron21:01:131
13964998461,16cyclictest13942-21cyclictest00:26:491
1397399837,26cyclictest1784-21sh22:15:402
1397399837,26cyclictest1784-21sh22:15:402
1397399833,34cyclictest29301-21/usr/sbin/munin19:46:292
1397399833,33cyclictest27447-21kworker/u17:119:41:132
1397399833,32cyclictest23979-21latency_hist23:46:162
1397399833,32cyclictest23979-21latency_hist23:46:162
1397399833,31cyclictest1514-21taskset19:59:042
13973998316,20cyclictest25797-21sh22:01:242
13973998316,20cyclictest25797-21sh22:01:242
13964998359,16cyclictest13942-21cyclictest22:36:401
13955998264,12cyclictest21555-21diskmemload21:31:400
13955998261,15cyclictest3499-21latency_hist20:06:160
13955998257,19cyclictest19429-21ssh23:37:270
13964998124,26cyclictest0-21swapper/121:19:221
13955998163,12cyclictest277-21dbus-daemon19:56:150
13964998061,11cyclictest2004-21idleruntime-cro22:16:131
13964998061,11cyclictest2004-21idleruntime-cro22:16:131
13964998022,28cyclictest29164-21apt-config23:01:141
13955998067,8cyclictest0-21swapper/023:01:320
13955998057,15cyclictest21555-21diskmemload21:26:130
13955998040,11cyclictest0-21swapper/000:16:350
1395599803,53cyclictest22491-21idleruntime-cro21:56:120
1397399793,31cyclictest7037-21fschecks_time20:16:352
1397399793,31cyclictest7037-21fschecks_time20:16:352
13964997953,18cyclictest352-21runrttasks23:51:141
13964997953,18cyclictest352-21runrttasks23:51:141
13955997956,17cyclictest21555-21diskmemload23:49:220
13955997956,17cyclictest21555-21diskmemload23:49:220
13955997955,9cyclictest0-21swapper/022:46:280
13955997954,18cyclictest19925-21gpgv22:46:170
13955997954,18cyclictest13396-21gpgv21:41:170
13955997954,18cyclictest13396-21gpgv21:41:170
13955997938,28cyclictest181rcu_preempt22:23:110
309962780,8sleep30-21swapper/321:16:183
1398099783,34cyclictest29768-21taskset23:01:443
13955997858,15cyclictest13942-21cyclictest22:56:120
13955997858,14cyclictest298-21in:imuxsock21:03:530
13955997858,14cyclictest298-21in:imuxsock21:03:530
13955997857,15cyclictest24350-21sh21:58:050
13964997759,12cyclictest31437-21kworker/u17:2-xprtiod22:21:481
13955997758,13cyclictest24401-21latency_hist19:31:170
13955997758,13cyclictest24401-21latency_hist19:31:170
13955997755,15cyclictest27689-21open_files23:51:440
13955997755,14cyclictest5246-21ssh23:14:310
1395599775,39cyclictest27361-21timerwakeupswit22:56:480
1395599774,40cyclictest14768-21/usr/sbin/munin21:42:400
1395599774,40cyclictest14768-21/usr/sbin/munin21:42:400
1395599773,41cyclictest11895-21apt-get20:31:270
13955997729,22cyclictest8452-21rm22:26:320
13955997729,22cyclictest8452-21rm22:26:320
13955997658,13cyclictest13942-21cyclictest19:46:380
13955997656,13cyclictest31895-21ssh22:11:300
13955997656,13cyclictest31895-21ssh22:11:300
1395599764,46cyclictest32603-21/usr/sbin/munin23:06:380
13955997635,10cyclictest161ktimers/023:57:410
1395599763,40cyclictest7559-21fschecks_time00:12:070
128302768,39sleep30-21swapper/318:56:443
827527512,9sleep08149-21latency_hist20:21:160
13964997554,14cyclictest298-21in:imuxsock23:41:121
13964997549,17cyclictest3212-21timerandwakeup22:16:481
13955997556,13cyclictest14264-21timerandwakeup20:36:490
13955997555,13cyclictest31034-21sh22:10:050
13964997453,15cyclictest11572-21latency_hist20:31:151
13964997453,15cyclictest11572-21latency_hist20:31:151
13964997452,14cyclictest31-21ksoftirqd/119:17:121
13964997444,22cyclictest12372-21fschecks_count23:26:351
13964997444,22cyclictest12372-21fschecks_count23:26:351
13964997410,54cyclictest18062-21apt-get20:51:271
1395599744,34cyclictest30566-21apt-get21:16:130
1395599744,34cyclictest30566-21apt-get21:16:130
1395599743,57cyclictest14802-21munin-run23:31:130
1395599743,57cyclictest14802-21munin-run23:31:130
1395599743,34cyclictest352-21runrttasks21:31:030
13964997353,14cyclictest24545-21latency_hist21:06:171
13964997348,15cyclictest0-21swapper/119:57:321
1396499732,29cyclictest0-21swapper/120:06:371
13955997357,11cyclictest13942-21cyclictest23:23:150
13955997352,14cyclictest4143-21wc20:06:470
13955997349,15cyclictest23508-21ssh23:45:350
13955997349,15cyclictest23508-21ssh23:45:350
1395599734,35cyclictest9940-21latency_hist20:26:160
1395599734,35cyclictest9940-21latency_hist20:26:160
13955997253,11cyclictest24993-21ssh21:06:320
1395599724,56cyclictest777-21/usr/sbin/munin00:01:360
13955997213,35cyclictest1-21systemd22:19:000
13964997154,11cyclictest1180-21tail23:06:501
13964997152,13cyclictest13942-21cyclictest22:41:441
13964997152,11cyclictest300-21rs:main1
13964997142,21cyclictest0-21swapper/122:51:471
1395599715,39cyclictest352-21runrttasks23:19:530
1395599715,39cyclictest352-21runrttasks23:19:530
1395599714,53cyclictest352-21runrttasks22:04:550
1395599714,53cyclictest352-21runrttasks22:04:550
1395599714,37cyclictest18294-21apt-key20:51:160
13955997142,11cyclictest181rcu_preempt19:06:310
13955997142,11cyclictest181rcu_preempt19:06:310
13964997054,10cyclictest0-21swapper/122:31:421
13964997051,14cyclictest2374-21systemd-journal21:28:441
13964997039,23cyclictest23526-21find21:56:461
1396499703,26cyclictest11040-21tail00:16:491
13964997016,20cyclictest0-21swapper/123:21:421
1395599705,43cyclictest24487-21/usr/sbin/munin19:31:380
1395599705,43cyclictest24487-21/usr/sbin/munin19:31:380
13955997052,11cyclictest20788-21systemd-run19:21:140
1395599703,55cyclictest19540-21unixbench_multi20:52:300
13964996955,10cyclictest13942-21cyclictest22:03:571
13964996955,10cyclictest13942-21cyclictest22:03:571
13964996947,15cyclictest0-21swapper/123:51:481
13964996930,27cyclictest15964-21runrttasks21:44:451
13964996930,27cyclictest15964-21runrttasks21:44:451
13964996927,31cyclictest29246-21latency22:06:391
1395599694,32cyclictest22553-21latency_hist19:26:160
1395599694,32cyclictest22553-21latency_hist19:26:160
1395599693,53cyclictest15717-21munin-node20:41:220
1395599693,37cyclictest31420-21cstates21:17:040
1395599693,34cyclictest27695-21/usr/sbin/munin19:41:390
1396499685,38cyclictest22701-21latency_hist19:26:171
1396499685,38cyclictest22701-21latency_hist19:26:171
13964996844,14cyclictest0-21swapper/119:51:131
13964996837,20cyclictest8311-21latency_hist20:21:151
13964996837,20cyclictest8311-21latency_hist20:21:151
1395599683,45cyclictest10586-21taskset20:26:450
1395599683,45cyclictest10586-21taskset20:26:450
1395599682,35cyclictest16580-21ntp_kernel_pll_00:26:410
13964996750,11cyclictest11085-21ntpd20:36:441
13964996744,15cyclictest4295-21latency_hist21:26:161
13964996711,41cyclictest22870-21apt-get19:26:441
13964996711,41cyclictest22870-21apt-get19:26:441
13955996750,10cyclictest21584-21systemd-run21:01:140
1395599674,53cyclictest17842-21latency_hist23:36:140
1395599673,37cyclictest8150-21apt20:21:120
1395599672,47cyclictest18283-21netstat19:11:400
13964996641,19cyclictest19159-21cut19:16:151
13964996637,19cyclictest6486-21latency_hist00:11:161
1396499662,43cyclictest19707-21latency_hist21:51:161
1395599664,33cyclictest11617-21seq22:31:380
13955996640,10cyclictest181rcu_preempt19:57:260
13955996631,13cyclictest181rcu_preempt19:36:360
13964996542,13cyclictest0-21swapper/120:16:161
13964996534,22cyclictest15272-21cat20:41:331
1396499653,41cyclictest12189-21fschecks_time20:32:351
13964996532,24cyclictest17964-21seq20:50:091
1395599654,42cyclictest5438-21fschecks_time20:11:340
1398099643,25cyclictest0-21swapper/300:11:343
13964996446,9cyclictest0-21swapper/119:41:341
13964996445,11cyclictest0-21swapper/123:11:261
1396499644,37cyclictest8290-21wc21:31:451
13964996440,14cyclictest0-21swapper/119:36:131
13964996440,14cyclictest0-21swapper/119:36:131
1396499643,43cyclictest8880-21grep23:21:151
1396499643,43cyclictest8880-21grep23:21:151
1396499643,42cyclictest27882-21ssh21:11:241
1396499643,42cyclictest27882-21ssh21:11:241
1396499643,36cyclictest24617-21latency_hist21:06:151
1396499643,28cyclictest11010-21latency_hist22:31:151
1396499643,28cyclictest11010-21latency_hist22:31:151
13964996350,7cyclictest0-21swapper/123:02:501
13964996336,19cyclictest0-21swapper/121:06:371
13964996334,21cyclictest3311-21kworker/u19:2+events_unbound20:06:131
13964996332,22cyclictest15085-21ssh23:31:191
13964996319,17cyclictest27441-21modprobe19:41:131
12602630,7sleep30-21swapper/323:06:523
13964996236,14cyclictest0-21swapper/120:21:331
13964996236,14cyclictest0-21swapper/120:21:331
13964996230,25cyclictest31234-21fschecks_time19:51:361
1398099613,46cyclictest15498-21chrt19:06:143
1398099596,25cyclictest0-21swapper/323:56:433
1398099592,31cyclictest917-21kworker/3:1+events19:31:423
1398099592,31cyclictest917-21kworker/3:1+events19:31:423
1398099583,38cyclictest8844-21taskset23:21:133
1398099583,38cyclictest8844-21taskset23:21:133
1398099582,34cyclictest10262-21taskset22:29:223
1398099582,34cyclictest10262-21taskset22:29:223
1398099574,39cyclictest18722-21taskset21:49:063
1398099572,41cyclictest10983-21chrt00:16:493
1398099563,39cyclictest2128-21chrt20:01:343
1398099562,34cyclictest11969-21taskset20:32:203
1398099553,39cyclictest4406-21taskset21:26:153
1398099553,39cyclictest19534-21taskset19:16:303
1398099553,37cyclictest4479-21taskset00:06:443
1398099553,34cyclictest24765-21chrt21:06:173
1398099553,34cyclictest24765-21chrt21:06:173
1398099543,35cyclictest25634-21chrt23:48:123
1398099543,35cyclictest25634-21chrt23:48:123
1398099543,35cyclictest15921-21chrt19:06:223
1398099543,35cyclictest15921-21chrt19:06:223
1398099542,38cyclictest12064-21chrt22:31:493
1398099542,36cyclictest25731-21taskset21:06:503
1398099533,38cyclictest20987-21chrt22:46:573
1398099533,36cyclictest3739-21chrt20:06:363
1398099533,35cyclictest7129-21taskset20:16:363
1398099533,35cyclictest7129-21taskset20:16:363
1398099533,35cyclictest1615-21chrt22:15:123
1398099533,35cyclictest1615-21chrt22:15:123
1398099533,34cyclictest28159-21taskset19:41:373
1398099533,34cyclictest16985-21taskset23:33:573
1398099533,33cyclictest4542-21chrt22:20:023
1398099532,37cyclictest29861-21taskset19:46:443
1398099532,36cyclictest20242-21chrt20:56:283
1398099523,35cyclictest2122-21chrt00:02:223
1398099523,35cyclictest18669-21taskset19:11:493
1398099523,34cyclictest9217-21chrt20:21:473
1398099523,34cyclictest9217-21chrt20:21:473
1398099523,34cyclictest11963-21chrt23:26:153
1398099522,35cyclictest26444-21chrt22:56:253
1398099514,35cyclictest15929-21chrt21:44:403
1398099514,35cyclictest15929-21chrt21:44:403
1398099513,33cyclictest31854-21chrt19:51:503
1398099513,33cyclictest25736-21chrt22:01:183
1398099513,33cyclictest25736-21chrt22:01:183
1398099513,33cyclictest15728-21chrt00:26:133
1398099513,33cyclictest15728-21chrt00:26:133
1398099512,37cyclictest26480-21chrt19:36:393
1398099512,35cyclictest31080-21chrt21:16:223
1398099512,34cyclictest20070-21chrt23:39:163
1398099512,33cyclictest21700-21chrt23:41:433
1398099512,33cyclictest21700-21chrt23:41:433
1398099504,33cyclictest27707-21taskset23:51:443
1398099503,36cyclictest20030-21chrt21:51:333
1398099503,35cyclictest23625-21chrt22:51:313
1398099503,34cyclictest9373-21chrt21:33:413
1398099503,31cyclictest4997-21chrt21:26:363
1398099493,34cyclictest5661-21chrt22:21:363
1398099493,32cyclictest1715-21chrt20:01:143
1398099493,26cyclictest917-21kworker/3:1+events22:36:243
1398099483,32cyclictest12458-21chrt23:26:363
1398099483,32cyclictest12458-21chrt23:26:363
1398099482,33cyclictest5279-21taskset23:14:363
1398099473,31cyclictest17329-21chrt20:46:443
1398099463,33cyclictest29725-21chrt21:13:553
1398099462,32cyclictest15848-21taskset20:41:463
1398099453,33cyclictest22427-21taskset19:26:143
1398099453,33cyclictest22427-21taskset19:26:143
1398099453,31cyclictest25058-21taskset22:00:043
1398099453,31cyclictest16420-21chrt00:26:373
1398099453,31cyclictest12197-21chrt21:38:153
1398099453,31cyclictest12197-21chrt21:38:153
1398099453,28cyclictest24386-21chrt19:31:173
1398099453,28cyclictest24386-21chrt19:31:173
1398099432,29cyclictest17245-21chrt22:41:253
1398099423,27cyclictest18567-21taskset20:51:223
13980994225,9cyclictest291572chrt22:06:373
1398099422,28cyclictest5348-21taskset20:11:303
1398099413,25cyclictest9994-21chrt20:26:163
1398099413,25cyclictest9994-21chrt20:26:163
1398099403,27cyclictest13604-21taskset20:36:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional