You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-13 - 13:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot4.osadl.org (updated Wed Nov 13, 2024 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24420612316272,29sleep00-21swapper/019:08:030
24418562278218,45sleep10-21swapper/119:05:511
113399690,1rtkit-daemon1132-21rtkit-daemon23:54:061
113399620,4rtkit-daemon1132-21rtkit-daemon21:19:161
24589562540,4sleep00-21swapper/019:50:010
113399490,4rtkit-daemon1132-21rtkit-daemon19:51:110
113399480,4rtkit-daemon1132-21rtkit-daemon22:07:320
113399480,3rtkit-daemon1132-21rtkit-daemon20:43:181
113399480,3rtkit-daemon1132-21rtkit-daemon20:21:571
113399480,3rtkit-daemon1132-21rtkit-daemon19:39:511
113399480,3rtkit-daemon1132-21rtkit-daemon00:21:181
113399460,3rtkit-daemon1132-21rtkit-daemon22:42:100
25248032450,2sleep00-21swapper/021:54:350
244249299434,27cyclictest2451130-21cat19:30:001
244249299424,12cyclictest2471149-21cut20:20:011
25064362410,2sleep02506462-21apt-get21:30:130
244249299402,13cyclictest2539055-21apt-get22:15:131
244249299392,20cyclictest2498943-21apt-get21:20:131
25438282380,6sleep10-21swapper/122:20:231
244249299373,13cyclictest2484844-21/usr/sbin/munin20:55:181
113399370,5rtkit-daemon2588084-21cstates23:20:161
244249299366,11cyclictest2582859-21ssh23:13:381
113399360,3rtkit-daemon0-21swapper/121:57:491
244249299354,12cyclictest2585312-21sed23:15:271
244249299354,10cyclictest2490545-21diskmemload00:10:221
244249299351,12cyclictest2463001-21apt-get20:00:141
244249299350,20cyclictest2595342-21apt-get23:30:161
113399350,4rtkit-daemon1132-21rtkit-daemon23:56:470
113399350,4rtkit-daemon1132-21rtkit-daemon19:10:250
113399350,3rtkit-daemon0-21swapper/123:15:340
244249299344,6cyclictest2536314-21wc22:10:211
244249299343,12cyclictest2490545-21diskmemload00:04:071
244249299343,12cyclictest2447356-21http19:20:141
244249299341,21cyclictest2462064-21sed19:55:231
244249299341,10cyclictest2607254-21memory23:45:191
113399340,5rtkit-daemon2498943-21apt-get21:20:120
113399340,4rtkit-daemon1132-21rtkit-daemon20:13:470
113399340,3rtkit-daemon1132-21rtkit-daemon00:16:410
113399340,3rtkit-daemon0-21swapper/123:10:060
113399340,3rtkit-daemon0-21swapper/121:35:531
113399340,3rtkit-daemon0-21swapper/100:08:141
113399340,2rtkit-daemon0-21swapper/023:46:360
244249299338,9cyclictest2574989-21sshd23:02:331
244249299331,21cyclictest2451835-21sed19:30:181
2442481993323,8cyclictest2464854-21cut20:05:000
113399330,3rtkit-daemon1132-21rtkit-daemon20:32:201
113399330,3rtkit-daemon0-21swapper/122:59:190
113399330,3rtkit-daemon0-21swapper/120:17:580
244249299324,6cyclictest0-21swapper/120:40:001
244249299324,17cyclictest2564186-21chrt22:48:381
244249299322,19cyclictest0-21swapper/100:18:331
244249299321,11cyclictest2602098-21sh23:38:541
244249299320,12cyclictest25571882sleep122:39:301
113399320,3rtkit-daemon1132-21rtkit-daemon22:50:420
113399320,3rtkit-daemon0-21swapper/122:19:110
113399320,3rtkit-daemon0-21swapper/019:15:451
244249299314,8cyclictest2606514-21cut23:45:011
244249299313,8cyclictest2491140-21apt-get21:10:151
244249299313,10cyclictest2466101-21timerwakeupswit20:05:241
2442492993127,2cyclictest65950irq/132-enp2s022:54:071
244249299311,17cyclictest2473141-21apt-get20:25:131
244249299311,12cyclictest26168222sleep123:58:241
244249299311,12cyclictest24843552sleep120:51:541
244249299311,11cyclictest26381762sleep100:26:221
244249299311,11cyclictest2488245-21sshd21:01:331
244249299310,5cyclictest26-21ksoftirqd/122:09:311
244249299310,14cyclictest2458269-21sed19:45:281
244249299310,11cyclictest2530383-21awk22:00:251
113399310,4rtkit-daemon1132-21rtkit-daemon23:27:200
113399310,3rtkit-daemon1132-21rtkit-daemon00:35:571
113399310,3rtkit-daemon0-21swapper/121:47:550
244249299305,7cyclictest2505569-21ssh21:28:411
244249299303,6cyclictest2510107-21latency_hist21:35:011
2442492993027,2cyclictest65950irq/132-enp2s022:55:141
244249299301,12cyclictest25525632sleep122:32:381
244249299301,12cyclictest2549224-21sshd22:28:331
244249299301,10cyclictest2480973-21cpu20:45:131
244249299300,13cyclictest2455333-21ls19:40:131
113399300,3rtkit-daemon1132-21rtkit-daemon21:52:291
113399300,3rtkit-daemon1132-21rtkit-daemon21:41:571
113399300,3rtkit-daemon1132-21rtkit-daemon20:08:270
113399300,3rtkit-daemon0-21swapper/121:35:250
113399300,3rtkit-daemon0-21swapper/119:25:180
113399300,3rtkit-daemon0-21swapper/023:25:141
113399300,3rtkit-daemon0-21swapper/022:42:171
244249299294,7cyclictest2488941-21ls21:05:141
2442492992925,2cyclictest65950irq/132-enp2s020:10:161
244249299291,10cyclictest2643861-21cut00:35:001
244249299291,10cyclictest2459519-21cat19:50:171
113399290,3rtkit-daemon0-21swapper/122:11:320
113399290,3rtkit-daemon0-21swapper/120:58:380
113399290,3rtkit-daemon0-21swapper/120:36:160
113399290,3rtkit-daemon0-21swapper/119:40:260
113399290,3rtkit-daemon0-21swapper/119:35:260
113399290,3rtkit-daemon0-21swapper/100:21:040
113399290,3rtkit-daemon0-21swapper/100:06:250
113399290,3rtkit-daemon0-21swapper/019:11:151
244249299281,10cyclictest2576544-21df_inode23:05:151
113399280,3rtkit-daemon1132-21rtkit-daemon19:55:200
113399280,3rtkit-daemon0-21swapper/123:42:560
113399280,3rtkit-daemon0-21swapper/120:43:390
2442481992718,7cyclictest2514276-21df21:40:150
113399270,3rtkit-daemon0-21swapper/123:37:560
113399270,3rtkit-daemon0-21swapper/122:22:590
113399260,22rtkit-daemon13-21ksoftirqd/020:28:130
25974442250,1sleep00-21swapper/023:32:020
244249299250,10cyclictest2521184-21turbostat21:49:591
244248199249,10cyclictest2482911-21apt-get20:50:130
244248199239,9cyclictest2617658-40mandb00:00:020
244248199239,9cyclictest2566952-21kworker/u8:123:20:150
244248199233,13cyclictest2475087-21apt-get20:30:130
244248199233,12cyclictest2529104-21apt-get22:00:120
244248199232,15cyclictest2488782-21apt-get21:05:140
244248199232,13cyclictest2625045-21apt-get00:10:160
2442481992311,2cyclictest141rcu_preempt22:25:240
244248199230,6cyclictest2503612-21ntp_states21:25:220
244248199230,5cyclictest2564829-21perf22:50:000
113399230,4rtkit-daemon1132-21rtkit-daemon19:32:430
244248199222,14cyclictest2643994-21apt-get00:35:140
244248199222,14cyclictest2610320-21apt-get23:50:190
244248199222,13cyclictest2636382-21apt-get00:25:130
244248199220,6cyclictest161rcuc/019:15:040
244248199213,10cyclictest2640213-21apt-get00:30:160
244248199211,6cyclictest0-21swapper/022:35:250
2442481992111,5cyclictest2480960-21apt-get20:45:120
2442481992110,7cyclictest13-21ksoftirqd/021:55:130
113399210,3rtkit-daemon1132-21rtkit-daemon23:07:460
244248199202,12cyclictest2550153-21apt-get22:30:100
2442481992012,6cyclictest2472538-21seq20:20:550
244248199200,5cyclictest2490568-21http21:10:030
244248199192,10cyclictest2572702-21apt-get23:00:130
244248199192,10cyclictest2486833-21apt-get21:00:120
2442481991913,4cyclictest13-21ksoftirqd/021:20:000
244248199190,5cyclictest0-21swapper/019:20:170
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:173
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
none16:11:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional