You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 03:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot3.osadl.org (updated Sat Jul 27, 2024 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31736499456456,0cyclictest0-21swapper/319:19:553
317364991311,1cyclictest0-21swapper/319:25:133
31736499130,10cyclictest0-21swapper/319:20:143
31736499128,1cyclictest0-21swapper/323:00:123
31736499120,11cyclictest0-21swapper/321:50:023
31736499120,11cyclictest0-21swapper/321:15:113
31736499120,11cyclictest0-21swapper/320:20:113
31736499120,11cyclictest0-21swapper/319:55:123
31736499120,11cyclictest0-21swapper/300:30:113
31736499119,0cyclictest0-21swapper/319:45:103
317364991111,0cyclictest0-21swapper/322:45:113
31736499110,11cyclictest0-21swapper/319:35:113
31736499110,10cyclictest0-21swapper/323:30:133
31736499110,0cyclictest0-21swapper/323:40:093
31736499110,0cyclictest0-21swapper/322:35:143
31736499110,0cyclictest0-21swapper/322:05:263
31736499110,0cyclictest0-21swapper/320:50:113
31736499110,0cyclictest0-21swapper/320:40:133
317364991010,0cyclictest0-21swapper/323:55:223
317364991010,0cyclictest0-21swapper/322:20:193
317364991010,0cyclictest0-21swapper/322:00:103
317364991010,0cyclictest0-21swapper/321:25:423
317364991010,0cyclictest0-21swapper/300:15:113
31736499100,10cyclictest0-21swapper/319:10:203
31736499100,0cyclictest0-21swapper/322:50:173
31736499100,0cyclictest0-21swapper/321:40:173
31736499100,0cyclictest0-21swapper/320:55:213
3173649999,0cyclictest0-21swapper/323:50:013
3173649999,0cyclictest0-21swapper/320:15:013
3173649999,0cyclictest0-21swapper/300:05:183
3173649990,9cyclictest0-21swapper/323:15:123
3173649988,0cyclictest0-21swapper/321:30:293
3173649988,0cyclictest0-21swapper/321:05:023
3173649988,0cyclictest0-21swapper/300:30:003
3173649987,1cyclictest0-21swapper/321:10:103
3173649980,8cyclictest0-21swapper/320:20:003
3173649980,0cyclictest0-21swapper/321:25:013
24942239870,3rtkit-daemon302478-21munin-node19:05:202
3173649966,0cyclictest0-21swapper/323:11:043
3173649966,0cyclictest0-21swapper/322:16:103
3173649966,0cyclictest0-21swapper/322:16:093
3173649960,6cyclictest0-21swapper/322:30:203
3173649960,6cyclictest0-21swapper/300:20:193
317167260,3sleep30-21swapper/319:09:563
3173649955,0cyclictest0-21swapper/323:55:013
3173649955,0cyclictest0-21swapper/320:37:193
3173649955,0cyclictest0-21swapper/320:32:573
3173649955,0cyclictest0-21swapper/320:26:203
3173649955,0cyclictest0-21swapper/300:35:113
3173649955,0cyclictest0-21swapper/300:13:113
316555251,2sleep10-21swapper/119:05:211
24942239850,2rtkit-daemon717-21lldpd21:33:552
435830242,1sleep1435895-21pmu-power23:50:171
374600240,0sleep1374610-21latency_hist21:30:011
3173649944,0cyclictest0-21swapper/323:25:093
3173649944,0cyclictest0-21swapper/323:05:113
3173649944,0cyclictest0-21swapper/322:29:373
3173649944,0cyclictest0-21swapper/322:15:023
3173649944,0cyclictest0-21swapper/320:05:133
3173649942,1cyclictest0-21swapper/319:40:333
3173649940,4cyclictest0-21swapper/321:35:113
3173649940,3cyclictest3560582sleep320:45:123
3173649940,2cyclictest0-21swapper/319:50:123
3173649940,2cyclictest0-21swapper/319:30:103
3173649940,2cyclictest0-21swapper/300:00:123
3173649940,1cyclictest0-21swapper/321:56:343
24942239840,3rtkit-daemon490-21rpcbind21:39:402
24942239840,3rtkit-daemon28-21ksoftirqd/122:38:481
24942239840,2rtkit-daemon717-21lldpd22:07:562
24942239840,2rtkit-daemon717-21lldpd22:04:272
24942239840,2rtkit-daemon717-21lldpd21:24:582
24942239840,2rtkit-daemon717-21lldpd00:20:292
24942239840,2rtkit-daemon375-21systemd-udevd23:27:292
24942239840,2rtkit-daemon375-21systemd-udevd20:59:302
24942239840,2rtkit-daemon2494222-21sendmail-mta23:19:582
24942239840,2rtkit-daemon1-21systemd22:10:102
24942239840,1rtkit-daemon717-21lldpd21:28:562
24942239840,1rtkit-daemon375-21systemd-udevd00:05:302
24942239840,1rtkit-daemon2489622-21systemd-journal19:47:322
24942239840,1rtkit-daemon2489622-21systemd-journal00:26:192
417564230,1sleep1417590-21apt-get23:10:101
402464230,1sleep2402490-21apt-get22:35:142
383075230,2sleep00-21swapper/021:50:010
348212230,1sleep2348238-21apt-get20:25:112
326978231,1sleep1327054-21latency19:30:141
3173649933,0cyclictest0-21swapper/323:35:103
3173649932,1cyclictest3827192sleep321:46:543
3173649931,1cyclictest0-21swapper/320:00:113
3173649930,2cyclictest0-21swapper/323:20:133
3173649930,2cyclictest0-21swapper/322:55:133
3173649930,2cyclictest0-21swapper/322:40:103
3173649930,2cyclictest0-21swapper/321:00:123
317097231,1sleep00-21swapper/019:09:000
24942239830,2rtkit-daemon617-21gmain20:35:012
24942239830,2rtkit-daemon3191333-21snmpd22:55:022
24942239830,2rtkit-daemon2494222-21sendmail-mta00:15:182
24942239830,1rtkit-daemon717-21lldpd21:56:582
24942239830,1rtkit-daemon717-21lldpd20:13:262
24942239830,1rtkit-daemon717-21lldpd20:08:522
24942239830,1rtkit-daemon717-21lldpd19:28:552
24942239830,1rtkit-daemon714-21ntpd23:10:212
24942239830,1rtkit-daemon714-21ntpd21:45:212
24942239830,1rtkit-daemon617-21gmain20:52:332
24942239830,1rtkit-daemon539-21wpa_supplicant23:00:222
24942239830,1rtkit-daemon539-21wpa_supplicant20:45:342
24942239830,1rtkit-daemon525-21dbus-daemon20:30:022
24942239830,1rtkit-daemon335002-21/usr/sbin/munin19:50:182
24942239830,1rtkit-daemon319422-21munin-node23:31:522
24942239830,1rtkit-daemon319422-21munin-node21:40:502
24942239830,1rtkit-daemon319422-21munin-node00:37:242
24942239830,1rtkit-daemon319422-21munin-node00:34:522
24942239830,1rtkit-daemon319422-21munin-node00:11:592
24942239830,1rtkit-daemon319422-21munin-node00:03:342
24942239830,1rtkit-daemon3191333-21snmpd22:34:571
24942239830,1rtkit-daemon3191333-21snmpd22:20:102
24942239830,1rtkit-daemon3191333-21snmpd21:50:162
24942239830,1rtkit-daemon3191333-21snmpd21:15:592
24942239830,1rtkit-daemon1-21systemd23:57:072
24942239830,1rtkit-daemon1-21systemd23:52:102
24942239830,1rtkit-daemon1-21systemd23:45:562
24942239830,1rtkit-daemon1-21systemd23:35:242
24942239830,1rtkit-daemon1-21systemd23:20:312
24942239830,1rtkit-daemon1-21systemd23:05:392
24942239830,1rtkit-daemon1-21systemd22:45:211
24942239830,1rtkit-daemon1-21systemd22:40:111
24942239830,1rtkit-daemon1-21systemd22:30:052
24942239830,1rtkit-daemon1-21systemd22:25:042
24942239830,1rtkit-daemon1-21systemd22:19:252
24942239830,1rtkit-daemon1-21systemd22:19:252
24942239830,1rtkit-daemon1-21systemd21:10:332
24942239830,1rtkit-daemon1-21systemd21:06:342
24942239830,1rtkit-daemon1-21systemd20:40:152
24942239830,1rtkit-daemon1-21systemd19:44:342
24942239830,1rtkit-daemon1-21systemd19:21:052
24942239830,1rtkit-daemon1-21systemd19:18:182
24942239830,0rtkit-daemon1-21systemd23:40:462
456041220,1sleep0456045-21ssh00:38:070
450623220,1sleep1450694-21irqstats00:25:141
445909220,1sleep10-21swapper/100:15:021
445371220,0sleep00-21swapper/000:14:410
442814220,0sleep00-21swapper/000:05:530
437174220,1sleep10-21swapper/123:55:121
434800220,1sleep10-21swapper/123:50:001
426117220,0sleep00-21swapper/023:28:180
423579220,0sleep00-21swapper/023:21:550
420779220,1sleep1420930-21smartctl23:15:181
417825220,1sleep0418001-21diskstats23:10:130
398648220,1sleep0398781-21sed22:25:200
395689220,0sleep00-21swapper/022:19:110
395689220,0sleep00-21swapper/022:19:100
387766220,1sleep0388006-21df_inode22:00:130
386473220,1sleep1386755-21users21:55:231
384787220,0sleep00-21swapper/021:51:330
379749220,0sleep00-21swapper/021:40:170
369931220,0sleep00-21swapper/021:18:480
368649220,1sleep1368716-21irqstats21:15:161
357511220,0sleep00-21swapper/020:48:530
349887220,1sleep00-21swapper/020:30:000
346965220,1sleep0347070-21ntp_states20:20:160
343235220,1sleep10-21swapper/120:10:211
337133220,1sleep0337189-21grep19:55:190
331025220,1sleep1331150-21awk19:40:201
328404220,0sleep10-21swapper/119:35:101
323927220,0sleep00-21swapper/019:20:330
322657220,1sleep1322932-21ThreadPoolForeg19:20:141
321956220,0sleep10-21swapper/119:19:461
321656220,1sleep0321651-21dpkg-deb19:17:170
24942239820,1rtkit-daemon3191333-21snmpd19:10:012
24942239820,1rtkit-daemon1-21systemd20:21:302
24942239820,1rtkit-daemon1-21systemd20:15:412
24942239820,0rtkit-daemon0-21swapper/222:50:212
24942239820,0rtkit-daemon0-21swapper/221:00:122
24942239820,0rtkit-daemon0-21swapper/220:00:022
24942239820,0rtkit-daemon0-21swapper/219:55:202
24942239820,0rtkit-daemon0-21swapper/219:35:362
24942239820,0rtkit-daemon0-21swapper/219:30:102
454431210,0sleep10-21swapper/100:35:121
453055210,0sleep00-21swapper/000:30:170
452316210,0sleep10-21swapper/100:30:101
451503210,0sleep00-21swapper/000:25:210
448852210,0sleep00-21swapper/000:20:180
448062210,0sleep10-21swapper/100:20:111
445414210,0sleep00-21swapper/000:15:010
443552210,0sleep10-21swapper/100:10:131
441183210,0sleep10-21swapper/100:05:021
439314210,0sleep00-21swapper/000:00:080
439048210,0sleep10-21swapper/100:00:011
437360210,0sleep00-21swapper/023:55:150
436142210,0sleep00-21swapper/023:50:200
433935210,0sleep00-21swapper/023:45:190
430955210,0sleep10-21swapper/123:40:121
430881210,0sleep00-21swapper/023:40:110
429211210,0sleep00-21swapper/023:35:150
428821210,0sleep10-21swapper/123:35:121
426668210,0sleep10-21swapper/123:30:151
426636210,1sleep00-21swapper/023:30:140
424557210,0sleep10-21swapper/123:25:111
422209210,0sleep10-21swapper/123:20:161
420208210,0sleep00-21swapper/023:15:130
416793210,1sleep00-21swapper/023:05:340
414937210,0sleep10-21swapper/123:05:031
413230210,0sleep10-21swapper/123:00:131
413136210,0sleep00-21swapper/023:00:120
412007210,0sleep00-21swapper/022:55:240
410688210,0sleep10-21swapper/122:55:011
409201210,0sleep10-21swapper/122:50:141
408960210,0sleep00-21swapper/022:50:130
407191210,0sleep00-21swapper/022:45:160
406461210,0sleep20-21swapper/222:45:032
405458210,1sleep01-21systemd22:40:190
405020210,0sleep20-21swapper/222:40:132
402444210,0sleep00-21swapper/022:35:040
400431210,0sleep00-21swapper/022:30:110
398348210,0sleep10-21swapper/122:25:161
396524210,0sleep00-21swapper/022:20:150
396162210,0sleep10-21swapper/122:20:121
394075210,0sleep10-21swapper/122:15:111
394075210,0sleep10-21swapper/122:15:111
393165210,0sleep00-21swapper/022:10:430
391928210,0sleep10-21swapper/122:10:121
389725210,0sleep10-21swapper/122:05:141
389443210,0sleep00-21swapper/022:05:010
387576210,0sleep10-21swapper/122:00:101
385609210,0sleep00-21swapper/021:55:140
383452210,0sleep10-21swapper/121:50:141
382476210,0sleep10-21swapper/121:45:211
378831210,0sleep10-21swapper/121:40:021
377032210,1sleep00-21swapper/021:35:120
376719210,0sleep10-21swapper/121:35:011
376335210,0sleep00-21swapper/021:31:440
374858210,0sleep10-21swapper/121:30:121
372869210,0sleep00-21swapper/021:25:160
370797210,0sleep10-21swapper/121:20:121
370637210,0sleep00-21swapper/021:20:110
367544210,0sleep00-21swapper/021:11:390
366231210,0sleep10-21swapper/121:10:121
364582210,0sleep00-21swapper/021:05:140
364156210,0sleep10-21swapper/121:05:111
362972210,0sleep10-21swapper/121:00:271
361966210,0sleep00-21swapper/021:00:070
360295210,0sleep10-21swapper/120:55:161
360153210,0sleep00-21swapper/020:55:150
358473210,0sleep00-21swapper/020:50:130
358106210,0sleep10-21swapper/120:50:101
355924210,0sleep10-21swapper/120:45:101
355564210,0sleep00-21swapper/020:43:340
354108210,0sleep10-21swapper/120:40:151
352345210,0sleep10-21swapper/120:35:141
352182210,0sleep00-21swapper/020:35:130
350261210,0sleep10-21swapper/120:30:131
348530210,0sleep10-21swapper/120:25:141
348366210,0sleep00-21swapper/020:25:130
346658210,0sleep10-21swapper/120:20:131
345646210,0sleep00-21swapper/020:15:240
344100210,0sleep10-21swapper/120:15:001
342451210,0sleep00-21swapper/020:10:120
341051210,0sleep0341223-21python320:05:190
340815210,0sleep10-21swapper/120:05:161
338583210,0sleep00-21swapper/020:00:160
338342210,0sleep10-21swapper/120:00:121
336375210,0sleep10-21swapper/119:55:121
335666210,0sleep00-21swapper/019:50:220
334455210,0sleep10-21swapper/119:50:111
333044210,0sleep10-21swapper/119:45:151
332526210,0sleep00-21swapper/019:45:060
331990210,1sleep00-21swapper/019:44:350
328827210,0sleep00-21swapper/019:35:130
327290210,0sleep00-21swapper/019:30:170
324793210,0sleep10-21swapper/119:25:151
324543210,0sleep00-21swapper/019:25:020
317649210,0sleep10-21swapper/119:10:141
317525210,0sleep00-21swapper/019:10:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional