You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-11 - 09:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat Apr 11, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1811521240,12sleep00-21swapper/019:03:300
18174991238,89cyclictest22523-21apt-get22:43:412
1758821099,67sleep217672-21/usr/sbin/munin18:59:132
181599910731,67cyclictest26166-21ssh21:03:440
181599910731,67cyclictest26166-21ssh21:03:440
181599910459,37cyclictest30442-21apt-get22:03:350
181599910336,29cyclictest23427-21sendmail-msp00:33:250
181599910334,38cyclictest5860-21rm22:16:040
181709910240,12cyclictest0-21swapper/123:03:331
181709910233,11cyclictest0-21swapper/121:44:001
181709910233,11cyclictest0-21swapper/121:44:001
181599910272,20cyclictest21988-21apt-get22:43:410
181709910137,11cyclictest0-21swapper/100:13:571
18159999935,23cyclictest21603-21sed20:49:010
18159999837,26cyclictest13264-21apt-get22:28:550
18159999834,20cyclictest0-21swapper/020:54:260
1817499973,64cyclictest0-21swapper/221:19:022
1817499973,64cyclictest0-21swapper/221:19:022
1817099974,39cyclictest5107-21ssh23:08:371
18170999738,9cyclictest0-21swapper/121:15:241
18170999738,8cyclictest0-21swapper/100:03:281
18170999734,9cyclictest0-21swapper/123:23:431
1817099973,39cyclictest28779-21ssh22:53:471
1817099973,39cyclictest28779-21ssh22:53:471
18170999733,11cyclictest0-21swapper/100:08:421
18159999732,25cyclictest21405-21chrt23:34:310
18159999726,42cyclictest0-21swapper/022:51:470
18170999643,11cyclictest0-21swapper/122:49:111
18170999639,11cyclictest0-21swapper/120:48:461
1817099962,37cyclictest30548-21fschecks_time19:38:481
18159999635,20cyclictest16646-21sed20:34:010
178022968,59sleep117803-21sendmail-mta19:00:471
18170999535,12cyclictest0-21swapper/123:44:071
1817099953,40cyclictest2431-21latency_hist23:58:271
18170999532,12cyclictest0-21swapper/120:58:471
18170999532,12cyclictest0-21swapper/120:58:471
18159999563,22cyclictest1068-21apt-get19:48:400
18159999529,37cyclictest0-21swapper/021:17:010
1817099943,37cyclictest16587-21wc20:34:001
1817099942,39cyclictest13025-21apt-key22:28:291
18159999432,25cyclictest4295-21rm23:07:050
18159999431,24cyclictest10268-21fschecks_count22:23:470
18159999431,23cyclictest11861-21timerwakeupswit20:19:010
18159999424,22cyclictest0-21swapper/019:18:510
1817099934,38cyclictest352-21runrttasks00:07:581
18159999334,20cyclictest18176-21sed20:38:590
18159999333,53cyclictest30234-21cat22:03:270
18159999332,18cyclictest25573-21diskmemload23:49:110
18159999332,18cyclictest25573-21diskmemload23:49:110
18159999329,25cyclictest0-21swapper/000:18:590
1817099924,41cyclictest22810-21latency_hist23:38:281
1817099923,45cyclictest3278-21wc19:53:581
18159999263,20cyclictest24172-21apt-get20:58:380
18159999263,20cyclictest24172-21apt-get20:58:380
18159999235,26cyclictest25873-21latency_hist23:43:270
18159999234,21cyclictest18385-21runrttasks21:43:350
18159999234,21cyclictest18385-21runrttasks21:43:350
18159999232,24cyclictest12325-21ssh00:13:550
1817099915,32cyclictest2410-21latency_hist19:53:291
18170999149,37cyclictest18148-21cyclictest22:06:371
1817099913,34cyclictest28628-21latency_hist19:33:301
18159999162,19cyclictest29119-21apt-get21:08:380
18159999134,45cyclictest9301-21apt-get21:29:110
18159999134,45cyclictest9301-21apt-get21:29:110
1817099905,36cyclictest30618-21taskset23:50:091
1817099905,36cyclictest30618-21taskset23:50:091
18170999038,13cyclictest352-21runrttasks22:44:161
1817099903,37cyclictest14969-21fschecks_count00:18:471
1817099903,35cyclictest11228-21fschecks_time20:18:471
18159999034,24cyclictest3727-21sendmail22:13:260
18159999033,18cyclictest16874-21sh21:40:040
18159999031,25cyclictest19486-21sh00:25:560
18174998948,35cyclictest7800-21munin-run23:13:262
1817499892,59cyclictest23530-21taskset19:18:282
1817499892,59cyclictest23530-21taskset19:18:282
18170998944,11cyclictest11363-21fschecks_count23:18:471
18170998944,11cyclictest11363-21fschecks_count23:18:471
1817099893,38cyclictest13244-21/usr/sbin/munin22:29:241
1817099893,36cyclictest29511-21awk19:34:371
1817099892,41cyclictest2906-21/usr/sbin/munin21:18:361
1817099892,41cyclictest2906-21/usr/sbin/munin21:18:361
18159998959,22cyclictest25573-21diskmemload23:59:020
18159998952,26cyclictest31542-21apt-get22:58:370
18159998948,27cyclictest5097-21apt-get23:08:400
18159998936,33cyclictest6040-21sort00:03:490
18159998931,18cyclictest14983-21timerandwakeup23:24:010
18159998930,25cyclictest352-21runrttasks21:57:180
18159998930,25cyclictest352-21runrttasks21:57:180
18159998924,33cyclictest7761-21apt-get20:08:380
1817499884,72cyclictest0-21swapper/219:03:392
1817499883,70cyclictest0-21swapper/221:48:412
1817099883,37cyclictest352-21runrttasks22:59:311
1817099883,34cyclictest24093-21latency_hist21:53:291
18159998869,10cyclictest18341-21apt-get19:03:390
18159998861,19cyclictest7297-21sh21:24:590
18159998861,19cyclictest7297-21sh21:24:590
18159998855,21cyclictest9404-21apt-get20:13:400
18159998835,28cyclictest19580-21ntpq20:43:520
18159998833,18cyclictest4944-21ssh21:21:360
18159998833,18cyclictest4944-21ssh21:21:360
1817499875,71cyclictest0-21swapper/220:18:412
1817099874,33cyclictest7599-21latency_hist20:08:281
1817099874,33cyclictest7599-21latency_hist20:08:281
18170998735,10cyclictest0-21swapper/122:13:281
1817099873,38cyclictest352-21runrttasks21:36:151
18159998753,25cyclictest28546-21apt-get22:53:370
18159998753,25cyclictest28546-21apt-get22:53:370
18159998731,24cyclictest19654-21ls22:38:500
18159998724,34cyclictest26868-21mailstats23:43:580
1817499863,72cyclictest0-21swapper/221:08:382
1817499862,26cyclictest352-21runrttasks19:31:262
1817099864,37cyclictest352-21runrttasks20:17:121
1817099863,39cyclictest24107-21ntp_kernel_err19:18:541
1817099863,36cyclictest26115-21apt-get21:03:361
1817099863,36cyclictest26115-21apt-get21:03:361
18159998657,19cyclictest2702-21apt-get19:53:380
18159998646,27cyclictest12616-21apt-get20:23:380
18159998632,17cyclictest23198-21rm21:50:580
18159998625,24cyclictest0-21swapper/023:18:020
1817499854,70cyclictest0-21swapper/220:38:382
1817499853,76cyclictest0-21swapper/222:18:382
1817499853,76cyclictest0-21swapper/222:18:382
18174998531,46cyclictest0-21swapper/221:38:442
1817099854,32cyclictest352-21runrttasks19:26:141
1817099853,38cyclictest20638-21fschecks_time19:08:511
1817099853,38cyclictest20638-21fschecks_time19:08:511
18159998554,22cyclictest881-21latency_hist19:48:280
18159998549,24cyclictest6161-21apt-get20:03:370
18159998549,24cyclictest6161-21apt-get20:03:370
18159998543,31cyclictest0-21swapper/021:33:380
18159998533,18cyclictest27024-21fschecks_count19:28:480
18159998530,19cyclictest8773-21ssh22:20:490
18159998530,19cyclictest8773-21ssh22:20:490
1817499842,6cyclictest0-21swapper/222:38:422
1817099844,35cyclictest23437-21latency_hist19:18:281
1817099844,35cyclictest23437-21latency_hist19:18:281
1817099842,37cyclictest7800-21awk22:19:011
1817099842,37cyclictest7800-21awk22:19:011
18159998465,9cyclictest22019-21apt-get19:13:400
18159998465,9cyclictest22019-21apt-get19:13:400
18159998432,22cyclictest6117-21latency_hist20:03:290
18174998341,37cyclictest0-21swapper/200:23:252
1817499833,66cyclictest16302-21ssh22:33:362
1817099834,32cyclictest352-21runrttasks21:31:211
1817099834,32cyclictest352-21runrttasks21:31:211
18159998358,16cyclictest931-21sh23:54:240
18159998348,23cyclictest25228-21apt-get19:23:390
18159998331,42cyclictest28764-21/usr/sbin/munin19:34:190
18159998324,20cyclictest0-21swapper/023:29:430
18159998324,20cyclictest0-21swapper/023:29:430
88382820,10sleep225573-21diskmemload21:28:252
88382820,10sleep225573-21diskmemload21:28:252
1817499825,67cyclictest0-21swapper/200:08:392
1817499823,72cyclictest0-21swapper/221:53:372
1817499823,72cyclictest0-21swapper/221:53:372
1817499823,67cyclictest0-21swapper/220:08:412
1817499823,66cyclictest28408-21ssh23:47:232
18174998225,48cyclictest0-21swapper/219:59:052
1817099823,40cyclictest18651-21ssh00:23:591
18170998211,22cyclictest6169-21apt-get21:24:361
18170998211,22cyclictest6169-21apt-get21:24:361
1818199812,39cyclictest0-21swapper/321:04:313
1818199812,39cyclictest0-21swapper/321:04:313
18174998152,21cyclictest18238-21netstat00:23:502
18174998137,31cyclictest8588-21latency23:13:502
1817499813,63cyclictest0-21swapper/219:53:372
1817499812,34cyclictest32299-21expr23:53:442
1817099812,35cyclictest29100-21/usr/sbin/munin21:08:491
18159998160,13cyclictest297-21systemd-logind19:13:270
18159998160,13cyclictest297-21systemd-logind19:13:270
18159998152,20cyclictest11118-21apt-get23:18:360
18159998152,20cyclictest11118-21apt-get23:18:360
18159998151,19cyclictest16299-21apt-get22:33:400
1817499805,69cyclictest0-21swapper/220:13:382
18174998038,35cyclictest0-21swapper/220:58:542
18174998038,35cyclictest0-21swapper/220:58:542
1817499803,7cyclictest0-21swapper/222:08:382
18174998035,37cyclictest0-21swapper/221:14:482
1817499803,28cyclictest23898-21fschecks_time19:18:482
1817499803,24cyclictest9787-21cstates21:29:292
1817499803,24cyclictest9787-21cstates21:29:292
1817499802,61cyclictest29109-21apt-get23:48:362
1817499802,61cyclictest29109-21apt-get23:48:362
1817499802,34cyclictest14496-21ssh23:23:502
1817499802,31cyclictest18094-21latency_hist21:43:292
1817499802,31cyclictest18094-21latency_hist21:43:292
18159998061,9cyclictest14223-21apt-get20:28:390
18159998038,35cyclictest8659-21/usr/sbin/munin00:08:350
1817499793,71cyclictest0-21swapper/223:33:362
1817499793,70cyclictest0-21swapper/221:58:402
1817499793,6cyclictest0-21swapper/219:48:402
1817499793,32cyclictest14331-21rm21:36:212
18174997932,35cyclictest0-21swapper/200:13:542
1817499792,36cyclictest8571-21latency_hist00:08:292
1817499792,34cyclictest21641-21cat00:29:012
1817499792,32cyclictest19935-21latency_hist23:33:282
1817499792,32cyclictest19935-21latency_hist23:33:282
1817499792,31cyclictest28310-21ssh21:07:042
1817499792,31cyclictest28310-21ssh21:07:042
1817499792,31cyclictest20584-21grep19:08:502
1817499792,31cyclictest20584-21grep19:08:502
1817499792,30cyclictest23771-21/usr/sbin/munin23:38:572
18170997957,16cyclictest4113-21cpuspeed22:13:421
18159997958,15cyclictest31164-21timerwakeupswit19:39:020
1817499784,69cyclictest0-21swapper/219:34:182
18174997836,34cyclictest0-21swapper/223:59:002
18174997833,37cyclictest0-21swapper/222:58:542
1817499782,33cyclictest5331-21ssh22:14:352
1817499782,32cyclictest32394-21rm22:06:242
18174997812,50cyclictest2231-21wc23:03:422
18174997744,23cyclictest14133-21latency_hist20:28:292
1817499773,28cyclictest15716-21latency_hist20:33:282
1817499772,34cyclictest25327-21/usr/sbin/munin19:23:412
1817499772,31cyclictest13800-21sh22:29:192
1817499772,28cyclictest12063-21sed23:19:012
1817499772,28cyclictest12063-21sed23:19:012
1817499763,63cyclictest0-21swapper/220:03:392
1817499763,63cyclictest0-21swapper/220:03:392
1817499763,62cyclictest15858-21apt-get20:33:372
1817499763,28cyclictest32058-21/usr/sbin/munin19:43:432
1817499763,27cyclictest23202-21/usr/sbin/munin20:54:242
1817499762,37cyclictest22412-21apt-key20:53:302
1817499762,34cyclictest26409-21expr22:49:122
1817499762,33cyclictest28932-21ssh22:53:502
1817499762,33cyclictest28932-21ssh22:53:502
1817499762,33cyclictest10861-21switchtime22:24:002
1817499762,32cyclictest30646-21cat19:38:502
1817499762,27cyclictest19192-21cstates20:43:412
18170997542,12cyclictest181rcu_preempt23:43:251
1808027524,27sleep30-21swapper/319:03:303
18170997458,10cyclictest17301-21ssh22:34:021
1817099745,31cyclictest352-21runrttasks20:12:401
18170997448,18cyclictest0-21swapper/121:58:501
1817099733,29cyclictest8154-21seq23:13:401
18170997147,19cyclictest14000-21latency_hist20:28:271
18170997051,14cyclictest25721-21sh21:54:321
18170997051,14cyclictest25721-21sh21:54:321
18170996749,11cyclictest0-21swapper/120:43:291
18170996736,9cyclictest58-21kcompactd000:28:471
1817099662,49cyclictest15532-21cstates21:38:441
18170996550,10cyclictest31899-21/usr/sbin/munin19:43:431
1817099652,42cyclictest19668-21cron19:08:261
1818199643,45cyclictest0-21swapper/321:14:193
1817099633,42cyclictest20208-21/usr/sbin/munin22:39:021
18170996325,9cyclictest181rcu_preempt20:53:401
18181996214,38cyclictest0-21swapper/322:29:053
18181996211,30cyclictest0-21swapper/322:44:183
18170996240,7cyclictest181rcu_preempt20:29:011
18170996227,12cyclictest181rcu_preempt20:43:461
1817099613,31cyclictest17956-21threads23:28:591
1817099613,31cyclictest17956-21threads23:28:591
1817099612,43cyclictest4051-21apt-get19:58:401
18181995833,20cyclictest0-21swapper/319:34:143
1818199573,41cyclictest19013-21taskset22:38:253
1818199564,40cyclictest15670-21taskset21:38:483
1818199562,42cyclictest10573-21taskset21:29:483
1818199562,42cyclictest10573-21taskset21:29:483
1818199553,39cyclictest22178-21chrt23:36:413
1818199553,38cyclictest11639-21taskset20:18:583
1818199553,37cyclictest27050-21chrt19:28:483
1818199553,37cyclictest10738-21chrt20:18:253
1818199543,40cyclictest5955-21chrt00:03:483
1818199543,36cyclictest7499-21chrt20:08:253
1818199543,36cyclictest7499-21chrt20:08:253
1818199542,38cyclictest6639-21taskset21:24:413
1818199542,38cyclictest6639-21taskset21:24:413
1818199535,37cyclictest29220-21taskset22:53:583
1818199535,37cyclictest29220-21taskset22:53:583
1818199533,37cyclictest14308-21chrt21:36:173
1818199532,41cyclictest23863-21chrt21:52:503
1818199532,39cyclictest5503-21chrt23:08:493
322632520,7sleep30-21swapper/319:43:513
1818199524,36cyclictest3021-21taskset23:58:493
1818199524,36cyclictest24353-21taskset19:19:003
1818199524,35cyclictest1875-21chrt23:57:033
1818199523,40cyclictest14630-21taskset20:28:503
1818199523,35cyclictest32519-21taskset22:59:013
1818199523,34cyclictest5144-21chrt21:22:103
1818199523,34cyclictest5144-21chrt21:22:103
1818199522,39cyclictest20209-21chrt22:39:023
1818199522,37cyclictest23415-21chrt19:18:273
1818199522,37cyclictest23415-21chrt19:18:273
1818199522,36cyclictest25722-21taskset23:43:133
1818199522,36cyclictest1575-21chrt19:48:533
1818199514,34cyclictest18515-21chrt21:43:423
1818199514,34cyclictest18515-21chrt21:43:423
1818199514,33cyclictest27569-21chrt21:58:423
1818199513,37cyclictest14445-21chrt23:23:483
1818199513,36cyclictest15806-21chrt00:19:043
1818199513,35cyclictest3671-21taskset22:13:253
1818199513,35cyclictest26889-21taskset23:43:583
1818199513,34cyclictest5010-21taskset23:08:293
1818199512,38cyclictest14448-21chrt00:18:273
1818199512,37cyclictest21020-21chrt00:28:483
1818199503,37cyclictest8111-21taskset23:13:353
1818199502,36cyclictest24404-21taskset20:58:473
1818199502,36cyclictest24404-21taskset20:58:473
1818199502,35cyclictest9115-21chrt00:08:503
1818199502,35cyclictest2802-21taskset19:53:433
1818199493,34cyclictest29946-21taskset21:09:003
1818199493,33cyclictest9736-21chrt22:23:253
1818199493,33cyclictest9736-21chrt22:23:253
1818199493,30cyclictest17591-21chrt20:38:423
1818199493,28cyclictest0-21swapper/320:53:553
1818199492,35cyclictest4727-21taskset19:59:023
1818199492,35cyclictest31853-21chrt22:04:543
1818199483,34cyclictest21127-21chrt20:48:513
1818199483,32cyclictest13975-21chrt20:28:263
1818199483,31cyclictest31154-21taskset23:51:403
1818199483,31cyclictest31154-21taskset23:51:403
1818199483,30cyclictest18862-21chrt19:03:543
1818199482,36cyclictest26884-21chrt22:49:453
1818199482,36cyclictest20007-21chrt23:33:293
1818199482,36cyclictest20007-21chrt23:33:293
1818199482,32cyclictest27363-21chrt21:58:293
1818199482,32cyclictest26641-21chrt19:28:283
1818199473,34cyclictest21204-21taskset19:09:043
1818199473,34cyclictest21204-21taskset19:09:043
1818199473,32cyclictest18023-21taskset00:23:453
1818199473,32cyclictest16642-21chrt20:34:013
1818199472,33cyclictest19107-21chrt20:43:403
1818199472,32cyclictest26580-21chrt21:56:553
1818199472,32cyclictest11923-21taskset22:26:133
1818199464,33cyclictest5300-21taskset22:14:303
1818199462,32cyclictest12207-21chrt23:19:023
1818199462,32cyclictest12207-21chrt23:19:023
1818199432,30cyclictest7765-21chrt20:08:373
1818199392,24cyclictest31025-21taskset19:39:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional