You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-24 - 11:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot8.osadl.org (updated Sat May 24, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
749999911813,77cyclictest0-21swapper/019:10:090
750099882806,47cyclictest0-21swapper/120:30:251
749999813734,52cyclictest0-21swapper/020:30:250
74092541519,16sleep10-21swapper/119:09:291
2829621390,4sleep128295-21memory21:25:211
74999913017,30cyclictest0-21swapper/022:51:590
2168991050,4rtkit-daemon2167-21rtkit-daemon00:16:051
7500999516,49cyclictest0-21swapper/120:20:591
216899950,4rtkit-daemon2167-21rtkit-daemon19:10:401
216899940,4rtkit-daemon2167-21rtkit-daemon23:59:591
216899940,4rtkit-daemon2167-21rtkit-daemon23:42:351
216899940,4rtkit-daemon2167-21rtkit-daemon19:33:211
216899930,4rtkit-daemon2167-21rtkit-daemon23:19:341
216899930,4rtkit-daemon2167-21rtkit-daemon22:11:531
216899930,4rtkit-daemon2167-21rtkit-daemon22:11:531
216899930,4rtkit-daemon2167-21rtkit-daemon21:02:471
216899930,4rtkit-daemon2167-21rtkit-daemon20:25:411
7500999210,75cyclictest15524-21sh21:59:591
216899920,4rtkit-daemon2167-21rtkit-daemon22:44:131
216899900,5rtkit-daemon2167-21rtkit-daemon21:42:131
216899900,4rtkit-daemon2167-21rtkit-daemon21:30:381
216899890,4rtkit-daemon2167-21rtkit-daemon19:28:101
216899880,4rtkit-daemon2167-21rtkit-daemon22:09:031
216899880,4rtkit-daemon2167-21rtkit-daemon22:09:031
216899880,4rtkit-daemon2167-21rtkit-daemon19:51:461
216899880,4rtkit-daemon2167-21rtkit-daemon19:15:091
7500998630,27cyclictest0-21swapper/122:50:581
216899860,4rtkit-daemon2167-21rtkit-daemon22:37:541
216899860,4rtkit-daemon2167-21rtkit-daemon22:02:331
216899860,4rtkit-daemon2167-21rtkit-daemon20:53:221
216899860,4rtkit-daemon2167-21rtkit-daemon20:03:211
216899860,4rtkit-daemon2167-21rtkit-daemon19:35:351
7499998513,57cyclictest0-21swapper/023:33:590
216899850,4rtkit-daemon2167-21rtkit-daemon22:59:191
216899850,4rtkit-daemon2167-21rtkit-daemon22:16:381
216899850,4rtkit-daemon2167-21rtkit-daemon00:06:191
216899850,3rtkit-daemon2167-21rtkit-daemon21:08:261
216899840,3rtkit-daemon2167-21rtkit-daemon20:46:371
216899840,3rtkit-daemon2167-21rtkit-daemon19:57:251
216899820,4rtkit-daemon2167-21rtkit-daemon20:41:571
216899800,3rtkit-daemon2167-21rtkit-daemon22:12:530
216899800,3rtkit-daemon2167-21rtkit-daemon22:12:520
749999782,68cyclictest5341-21munin-node00:30:270
216899780,6rtkit-daemon0-21swapper/122:48:091
216899780,4rtkit-daemon2167-21rtkit-daemon19:20:160
216899780,4rtkit-daemon2167-21rtkit-daemon00:24:361
216899770,4rtkit-daemon2167-21rtkit-daemon21:08:310
216899770,36rtkit-daemon271ktimersoftd/121:50:531
7499997618,23cyclictest0-21swapper/023:50:580
625927629,33sleep00-21swapper/019:05:170
216899760,4rtkit-daemon2167-21rtkit-daemon00:02:140
7500997514,54cyclictest0-21swapper/119:23:591
749999752,55cyclictest9108-21latency_hist22:45:020
749999733,63cyclictest30170-21aten_r1power_fr22:25:160
749999732,64cyclictest10220-21ssh21:50:150
216899730,5rtkit-daemon2167-21rtkit-daemon21:49:031
216899730,4rtkit-daemon2167-21rtkit-daemon23:21:540
216899730,4rtkit-daemon2167-21rtkit-daemon19:45:251
216899730,34rtkit-daemon2167-21rtkit-daemon20:59:521
749999722,63cyclictest15538-21idleruntime-cro22:00:000
749999722,51cyclictest27451-21latency_hist21:25:020
7499997213,53cyclictest0-21swapper/022:17:580
749999712,62cyclictest8407-21aten2.4-expect00:35:140
749999712,62cyclictest18425-21ssh22:05:010
749999712,54cyclictest18310-21latency_hist19:40:010
749999712,52cyclictest21922-21idleruntime-cro19:50:000
216899710,4rtkit-daemon2167-21rtkit-daemon20:36:021
216899710,4rtkit-daemon2167-21rtkit-daemon00:38:251
216899710,4rtkit-daemon2167-21rtkit-daemon00:03:351
749999706,57cyclictest762-21NetworkManager23:01:010
749999706,57cyclictest0-21swapper/021:35:010
749999702,42cyclictest11276-21latency_hist20:50:020
749999702,36cyclictest724-21ssh23:25:270
216899700,4rtkit-daemon2167-21rtkit-daemon23:10:591
749999698,53cyclictest0-21swapper/021:45:190
749999695,57cyclictest0-21swapper/019:27:590
749999693,60cyclictest18510-21diskmemload23:10:130
749999693,59cyclictest21520-21ssh23:05:240
749999693,59cyclictest21520-21ssh23:05:230
749999692,60cyclictest4308-21ssh00:27:290
749999692,60cyclictest2772-21ssh22:33:140
749999692,60cyclictest18510-21diskmemload22:47:210
749999692,51cyclictest27345-21latency_hist20:05:020
216899690,4rtkit-daemon2167-21rtkit-daemon19:41:161
216899690,30rtkit-daemon2167-21rtkit-daemon22:26:041
749999685,57cyclictest4200-21ssh21:40:030
749999685,56cyclictest0-21swapper/022:05:570
749999685,56cyclictest0-21swapper/022:05:560
7499996846,16cyclictest0-21swapper/023:15:170
749999682,47cyclictest25217-21sshd00:08:310
750099679,46cyclictest0-21swapper/123:37:581
7500996730,31cyclictest0-21swapper/120:18:591
7500996717,43cyclictest0-21swapper/123:09:001
7500996717,43cyclictest0-21swapper/123:08:591
749999675,55cyclictest0-21swapper/020:13:410
749999673,38cyclictest25929-21munin-node00:10:260
749999672,59cyclictest13272-21ssh23:47:230
749999672,47cyclictest1067-21snmpd23:42:430
749999672,37cyclictest4899-21ssh22:35:500
216899670,4rtkit-daemon2167-21rtkit-daemon23:47:241
216899670,4rtkit-daemon2167-21rtkit-daemon23:32:001
216899670,4rtkit-daemon2167-21rtkit-daemon23:22:301
216899670,4rtkit-daemon2167-21rtkit-daemon20:10:511
749999665,55cyclictest0-21swapper/020:50:000
749999662,50cyclictest19887-21idleruntime-cro00:00:010
7499996616,34cyclictest21517-21latency_hist21:15:020
216899660,4rtkit-daemon2167-21rtkit-daemon21:20:421
749999653,55cyclictest28855-21aten_r1power_cu00:15:150
749999653,36cyclictest6183-21if_err_eth023:35:190
7499996526,32cyclictest0-21swapper/021:36:030
749999652,57cyclictest17713-21latency_hist23:00:010
749999652,56cyclictest27415-21cpu22:20:210
749999652,56cyclictest23847-21ssh21:18:010
749999652,56cyclictest15388-21gltestperf21:00:160
749999652,35cyclictest27852-21grep20:05:150
216899650,4rtkit-daemon2167-21rtkit-daemon23:50:101
216899650,4rtkit-daemon2167-21rtkit-daemon23:26:191
216899650,4rtkit-daemon2167-21rtkit-daemon23:01:481
216899650,4rtkit-daemon2167-21rtkit-daemon21:17:111
216899650,4rtkit-daemon2167-21rtkit-daemon21:11:371
216899650,4rtkit-daemon2167-21rtkit-daemon20:09:261
7500996416,30cyclictest0-21swapper/122:32:591
749999642,48cyclictest2256-21latency_hist00:25:010
216899640,4rtkit-daemon2167-21rtkit-daemon22:22:241
216899640,4rtkit-daemon2167-21rtkit-daemon21:38:421
216899640,4rtkit-daemon2167-21rtkit-daemon00:30:411
216899640,4rtkit-daemon2167-21rtkit-daemon00:12:461
749999632,54cyclictest29945-21ssh21:28:310
216899630,4rtkit-daemon2167-21rtkit-daemon00:25:301
749999623,53cyclictest22846-21open_inodes19:50:240
749999622,54cyclictest14123-21mailstats20:55:240
749999622,53cyclictest31300-21cpu20:15:150
749999622,34cyclictest9480-21aten_r1power_en19:15:120
749999612,34cyclictest4059-21latency_hist20:30:010
749999602,52cyclictest1067-21snmpd20:23:420
749999593,36cyclictest7674-21munin-run20:40:000
749999592,52cyclictest19889-21chrt19:42:520
749999592,51cyclictest7836-21munin-node20:40:230
749999582,49cyclictest1067-21snmpd19:56:520
749999562,48cyclictest14928-21munin-node19:30:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional