You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-24 - 09:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot4.osadl.org (updated Wed Apr 24, 2024 00:44:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24080772270196,58sleep00-21swapper/019:08:130
24078692250190,45sleep10-21swapper/119:05:581
256703321580,4sleep126-21ksoftirqd/123:57:421
256703321580,4sleep126-21ksoftirqd/123:57:421
159199820,4rtkit-daemon1590-21rtkit-daemon00:10:090
24146482580,3sleep10-21swapper/119:25:201
159199540,3rtkit-daemon1590-21rtkit-daemon23:09:230
159199520,4rtkit-daemon1590-21rtkit-daemon21:23:431
159199520,4rtkit-daemon1590-21rtkit-daemon00:29:300
159199500,4rtkit-daemon1590-21rtkit-daemon22:27:400
159199500,4rtkit-daemon1590-21rtkit-daemon00:20:080
159199470,4rtkit-daemon1590-21rtkit-daemon23:15:491
240836299462,16cyclictest2571394-21apt-get00:05:141
240836299443,12cyclictest2577159-21apt-get00:15:111
240836299443,11cyclictest2472817-21apt-get21:35:111
25177192430,4chrt0-21swapper/022:40:280
240836299433,11cyclictest2408504-21apt-get19:10:121
240836299433,11cyclictest2408504-21apt-get19:10:111
240836299413,10cyclictest2590580-21apt-get00:35:141
240836299402,8cyclictest2542317-21apt-get23:20:101
2408362993912,7cyclictest63950irq/130-enp2s023:35:171
240836299391,13cyclictest2451636-21apt-get21:00:161
2408362993910,7cyclictest63950irq/130-enp2s021:05:131
240836299382,12cyclictest2506977-21apt-get22:25:141
240836299381,13cyclictest2466066-21apt-get21:25:131
240836299372,14cyclictest2419524-21apt-get19:40:141
159199370,5rtkit-daemon2497492-21cat22:10:231
159199370,4rtkit-daemon0-21swapper/019:29:510
159199370,3rtkit-daemon0-21swapper/022:01:421
159199370,3rtkit-daemon0-21swapper/021:06:390
159199370,3rtkit-daemon0-21swapper/020:47:070
240836299362,9cyclictest2561789-21apt-get23:50:121
240836299362,9cyclictest2441840-21apt-get20:35:091
159199360,3rtkit-daemon0-21swapper/023:02:360
240836299352,9cyclictest2516588-21apt-get22:40:141
159199350,3rtkit-daemon0-21swapper/020:28:170
159199350,3rtkit-daemon0-21swapper/000:18:170
240836299342,9cyclictest2427207-40apt-check19:57:121
240836299342,7cyclictest2449659-21apt-get20:55:111
159199340,4rtkit-daemon1590-21rtkit-daemon22:30:310
159199340,3rtkit-daemon0-21swapper/021:47:240
159199340,3rtkit-daemon0-21swapper/019:37:261
240836299332,9cyclictest2526132-21apt-get22:55:101
240836299331,12cyclictest2427734-21apt-get20:00:131
159199330,4rtkit-daemon2560782-21ssh23:47:500
159199330,3rtkit-daemon0-21swapper/022:16:361
159199330,3rtkit-daemon0-21swapper/000:03:231
240836299322,7cyclictest2493280-21apt-get22:05:131
159199320,4rtkit-daemon1590-21rtkit-daemon20:22:220
159199320,4rtkit-daemon1590-21rtkit-daemon19:23:270
159199320,4rtkit-daemon1590-21rtkit-daemon00:30:401
159199320,3rtkit-daemon0-21swapper/121:31:120
159199320,3rtkit-daemon0-21swapper/022:54:300
159199320,3rtkit-daemon0-21swapper/020:17:561
159199320,3rtkit-daemon0-21swapper/020:05:111
159199310,4rtkit-daemon1590-21rtkit-daemon21:53:551
159199310,4rtkit-daemon1590-21rtkit-daemon19:38:320
159199310,3rtkit-daemon1590-21rtkit-daemon23:22:220
159199310,3rtkit-daemon0-21swapper/020:22:141
25751182300,2sleep12575115-21ps00:10:231
159199300,3rtkit-daemon1590-21rtkit-daemon22:10:160
159199300,3rtkit-daemon1590-21rtkit-daemon20:13:420
159199300,3rtkit-daemon1590-21rtkit-daemon19:19:010
159199300,3rtkit-daemon0-21swapper/121:35:150
159199300,3rtkit-daemon0-21swapper/022:31:411
159199290,3rtkit-daemon0-21swapper/019:18:181
159199280,3rtkit-daemon1590-21rtkit-daemon22:22:480
159199280,3rtkit-daemon0-21swapper/123:19:210
159199280,3rtkit-daemon0-21swapper/122:36:440
159199280,3rtkit-daemon0-21swapper/023:07:121
159199280,3rtkit-daemon0-21swapper/022:53:261
159199280,3rtkit-daemon0-21swapper/021:59:031
159199280,3rtkit-daemon0-21swapper/021:41:271
159199280,3rtkit-daemon0-21swapper/020:32:001
159199280,23rtkit-daemon1-21systemd21:13:511
159199280,1rtkit-daemon1590-21rtkit-daemon19:56:590
159199270,3rtkit-daemon0-21swapper/020:29:061
240836299260,6cyclictest0-21swapper/120:11:401
240835999266,18cyclictest0-21swapper/021:50:020
159199260,21rtkit-daemon2408353-21cyclictest23:26:321
159199260,1rtkit-daemon1590-21rtkit-daemon00:06:100
240836299253,16cyclictest2548830-21apt-get23:30:131
240836299252,16cyclictest2558544-21apt-get23:45:121
240836299250,6cyclictest0-21swapper/119:21:481
240835999253,14cyclictest2447714-21apt-get20:50:130
240835999252,16cyclictest2476569-21apt-get21:40:140
159199250,1rtkit-daemon1590-21rtkit-daemon21:30:531
240835999248,10cyclictest2457695-1kworker/u9:200:00:130
240835999246,16cyclictest2468995-21python321:30:010
240835999245,17cyclictest0-21swapper/000:40:000
2408359992417,5cyclictest2567883-40ogrotate00:00:000
2408359992417,5cyclictest2567883-40ogrotate00:00:000
159199240,20rtkit-daemon0-21swapper/100:25:041
159199240,14rtkit-daemon13-21ksoftirqd/020:19:230
240836299230,9cyclictest2482741-21python321:50:011
240835999233,14cyclictest2421471-21apt-get19:45:140
240835999231,5cyclictest2441270-21latency_hist20:35:000
2408359992311,2cyclictest2453382-21latency_hist21:05:010
159199230,4rtkit-daemon1590-21rtkit-daemon23:34:160
240836299222,14cyclictest2459433-21apt-get21:15:141
2408362992216,4cyclictest2445565-21turbostat20:45:001
2408362992211,6cyclictest63950irq/130-enp2s023:40:131
240835999227,12cyclictest2455718-21diskmemload00:35:000
240835999222,14cyclictest2519818-21apt-get22:45:130
240835999222,14cyclictest2415601-21apt-get19:30:130
2408359992216,4cyclictest2462581-21latency_hist21:20:000
240835999221,19cyclictest2496220-21python322:10:010
240836299218,7cyclictest2529364-21apt-get23:00:141
240836299210,19cyclictest2447159-21chrt20:46:261
240835999215,3cyclictest141rcu_preempt21:10:120
240835999211,3cyclictest2436527-1kworker/0:1H20:35:030
2408359992112,5cyclictest2455718-21diskmemload23:35:510
240835999210,9cyclictest2445432-21sshd20:43:480
159199210,3rtkit-daemon1590-21rtkit-daemon19:46:041
159199210,1rtkit-daemon1590-21rtkit-daemon20:57:260
240836299203,10cyclictest2580341-21apt-get00:20:141
240836299202,13cyclictest2513368-21apt-get22:35:161
240836299202,13cyclictest2423422-21apt-get19:50:131
240835999202,16cyclictest2408811-21tune2fs19:10:180
240835999202,16cyclictest2408811-21tune2fs19:10:170
240835999202,13cyclictest2423403-21/usr/sbin/munin19:50:320
2408359992016,2cyclictest2431495-21latency_hist20:10:010
240835999201,2cyclictest2493105-21latency_hist22:05:000
240835999201,17cyclictest2486987-21tune2fs21:55:180
240835999200,3cyclictest2546756-21timerandwakeup23:25:260
240835999200,3cyclictest2527500-21ssh22:55:270
240835999200,18cyclictest2465899-21cut21:25:020
240835999200,18cyclictest2428609-21ps20:00:260
159199200,12rtkit-daemon0-21swapper/019:42:530
240836299199,5cyclictest2455718-21diskmemload23:10:201
2408362991914,3cyclictest2503628-21/usr/sbin/munin22:20:241
240835999193,9cyclictest2535915-21apt-get23:10:130
240835999191,17cyclictest2500359-21tune2fs22:15:150
240835999190,7cyclictest1855330-20systemd-journal23:55:000
240836299182,8cyclictest2415601-21apt-get19:30:111
2408362991813,3cyclictest2447696-21/usr/sbin/munin20:50:181
2408359991813,3cyclictest2556970-21sh23:41:230
240836299170,15cyclictest2519780-21ssh22:45:071
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional