You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 21:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot8.osadl.org (updated Thu Dec 04, 2025 12:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2893699870799,62cyclictest0-21swapper/007:39:350
28937998434,12cyclictest0-21swapper/107:39:361
287602666643,16sleep00-21swapper/007:08:320
2893799396318,46cyclictest0-21swapper/107:10:051
286882350330,14sleep10-21swapper/107:07:521
28936991059,71cyclictest27874-21ssh12:28:590
2893699994,69cyclictest0-21swapper/007:10:050
28936999313,62cyclictest0-21swapper/008:25:580
28936999313,61cyclictest0-21swapper/009:47:590
28936999217,68cyclictest0-21swapper/012:02:580
28937998511,67cyclictest0-21swapper/111:17:591
216899830,4rtkit-daemon2167-21rtkit-daemon12:26:321
216899830,3rtkit-daemon2167-21rtkit-daemon10:13:190
187412830,4sleep118740-21ssh12:12:321
52662820,4sleep15264-21munin-node11:50:131
28937998170,6cyclictest28162-21ssh10:37:581
216899810,11rtkit-daemon0-21swapper/112:16:321
28936998013,53cyclictest0-21swapper/012:18:590
216899790,4rtkit-daemon2167-21rtkit-daemon09:36:541
216899780,5rtkit-daemon2167-21rtkit-daemon11:36:161
2893699773,8cyclictest25319-21idleruntime-cro12:25:000
216899770,4rtkit-daemon2167-21rtkit-daemon10:49:051
28936997633,31cyclictest0-21swapper/008:04:000
28936997610,58cyclictest2916-21missed_timers11:45:210
216899760,4rtkit-daemon2167-21rtkit-daemon12:38:171
216899760,4rtkit-daemon2167-21rtkit-daemon07:20:171
2893699753,8cyclictest14990-21ssh10:15:190
2893699752,9cyclictest20267-21munin-node10:25:270
2893699752,7cyclictest19836-21ssh11:20:010
2893699752,67cyclictest7660-21diskmemload09:58:230
2893699742,6cyclictest11936-21unixbench_singl09:15:280
28936997416,37cyclictest0-21swapper/012:30:160
216899740,5rtkit-daemon2167-21rtkit-daemon11:31:010
216899740,4rtkit-daemon2167-21rtkit-daemon09:40:330
216899740,4rtkit-daemon2167-21rtkit-daemon09:33:181
2893699732,65cyclictest17933-21timerwakeupswit12:10:270
28936997315,53cyclictest0-21swapper/008:45:580
216899730,4rtkit-daemon2167-21rtkit-daemon11:53:460
216899730,33rtkit-daemon2167-21rtkit-daemon11:30:011
2893699722,7cyclictest9187-21latency10:05:200
216899720,4rtkit-daemon2167-21rtkit-daemon08:17:170
216899720,32rtkit-daemon2167-21rtkit-daemon11:30:271
28937997114,39cyclictest0-21swapper/107:31:591
2893699715,9cyclictest0-21swapper/008:30:280
2893699715,49cyclictest0-21swapper/009:25:010
2893699713,8cyclictest12523-21ssh11:05:300
2893699713,7cyclictest23477-21ssh11:25:190
2893699713,7cyclictest16638-21ssh12:10:010
2893699712,7cyclictest29155-21aten_r1power_vo10:40:120
2893699712,50cyclictest5472-21seq09:01:160
216899710,4rtkit-daemon2167-21rtkit-daemon08:44:580
216899710,4rtkit-daemon2167-21rtkit-daemon08:06:170
216899710,3rtkit-daemon2167-21rtkit-daemon09:50:241
28937997016,35cyclictest0-21swapper/111:03:591
28937997015,48cyclictest78850irq/45-eth0-rx-12:31:591
28937997015,36cyclictest0-21swapper/108:12:591
2893699703,7cyclictest29114-21idleruntime-cro08:40:000
2893699702,8cyclictest19847-21kworker/0:111:40:250
2893699702,7cyclictest9490-21grep11:00:270
2893699702,7cyclictest21219-21sed11:20:300
28936997017,47cyclictest78950irq/46-eth0-tx-11:10:110
216899700,4rtkit-daemon2167-21rtkit-daemon11:56:470
216899700,4rtkit-daemon2167-21rtkit-daemon09:10:181
216899700,3rtkit-daemon14213-21ssh10:14:491
28937996914,35cyclictest0-21swapper/108:43:581
2893699693,7cyclictest18166-21ssh10:20:240
2893699692,8cyclictest7660-21diskmemload09:50:200
2893699692,7cyclictest7660-21diskmemload09:12:140
2893699692,7cyclictest29663-21sendmail_mailqu11:35:250
2893699692,61cyclictest78950irq/46-eth0-tx-10:50:140
2893699692,60cyclictest1628-21sh10:47:570
216899690,4rtkit-daemon2167-21rtkit-daemon12:20:281
216899690,4rtkit-daemon2167-21rtkit-daemon07:15:410
28937996817,33cyclictest0-21swapper/108:59:001
28937996813,37cyclictest0-21swapper/109:41:591
2893699682,8cyclictest5968-21if_eth010:55:200
2893699682,7cyclictest23824-21ntpq09:35:250
28937996718,34cyclictest0-21swapper/111:56:591
28937996714,37cyclictest0-21swapper/107:50:001
28937996713,33cyclictest0-21swapper/107:59:591
28937996712,38cyclictest0-21swapper/112:09:581
2893699675,37cyclictest0-21swapper/010:00:180
2893699673,7cyclictest19968-21munin-node09:30:270
2893699672,7cyclictest7711-21ssh09:10:010
2893799669,43cyclictest0-21swapper/109:17:001
28937996619,32cyclictest0-21swapper/111:49:581
28937996616,32cyclictest0-21swapper/110:22:591
28937996615,31cyclictest0-21swapper/108:27:591
28937996614,36cyclictest0-21swapper/107:43:591
28937996614,35cyclictest0-21swapper/109:03:581
28937996614,34cyclictest0-21swapper/110:00:001
28937996613,38cyclictest0-21swapper/107:29:591
2893699667,54cyclictest10692-21kworker/0:209:29:490
2893699665,55cyclictest0-21swapper/010:31:120
2893699664,56cyclictest0-21swapper/012:37:030
2893699663,6cyclictest11804-21latency07:50:190
2893699662,7cyclictest4373-21gltestperf07:30:160
28937996515,35cyclictest0-21swapper/109:22:591
28937996515,33cyclictest0-21swapper/111:20:591
28937996514,33cyclictest0-21swapper/110:58:591
28937996513,34cyclictest0-21swapper/107:54:591
2893699655,54cyclictest0-21swapper/010:35:170
28936996528,26cyclictest0-21swapper/008:50:160
2893699652,7cyclictest8342-21munin-node07:40:240
2893699652,53cyclictest3231-21timerwakeupswit07:25:260
28936996512,30cyclictest14669-21latency_hist08:00:010
28937996416,30cyclictest0-21swapper/110:07:591
28937996415,33cyclictest0-21swapper/109:05:591
2893699645,9cyclictest0-21swapper/008:55:290
2893699642,6cyclictest22787-21grep08:20:230
28937996311,33cyclictest0-21swapper/110:33:591
28937996310,36cyclictest0-21swapper/107:17:591
2893699632,7cyclictest1067-21snmpd07:48:020
28937996217,33cyclictest0-21swapper/108:08:591
28937996214,34cyclictest0-21swapper/108:20:581
28937996214,29cyclictest0-21swapper/109:25:591
28937996213,33cyclictest0-21swapper/108:32:591
2893699622,7cyclictest19098-21needreboot08:10:200
2893799619,32cyclictest0-21swapper/109:45:591
28937996111,34cyclictest0-21swapper/110:01:581
28937996010,37cyclictest0-21swapper/108:39:591
28937996010,33cyclictest0-21swapper/110:26:591
28937996010,31cyclictest0-21swapper/108:45:591
2893699592,7cyclictest608-21munin-node07:20:180
2893799589,29cyclictest0-21swapper/108:17:591
28937995812,32cyclictest0-21swapper/108:02:581
28937995617,27cyclictest0-21swapper/110:53:001
216899560,13rtkit-daemon2167-21rtkit-daemon08:50:121
28937995510,33cyclictest0-21swapper/110:41:591
216899550,4rtkit-daemon2167-21rtkit-daemon11:09:311
28937995411,28cyclictest0-21swapper/111:40:591
158942534,13sleep10-21swapper/110:16:031
157442534,12sleep10-21swapper/111:11:251
2893799515,33cyclictest0-21swapper/112:01:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional