You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 04:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot4.osadl.org (updated Sat Jul 27, 2024 00:44:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12745502261183,28sleep00-21swapper/019:06:080
12746422240197,29sleep10-21swapper/119:07:071
14339192670,4sleep10-21swapper/123:40:011
159199540,3rtkit-daemon1590-21rtkit-daemon19:38:030
159199530,4rtkit-daemon1590-21rtkit-daemon21:06:051
13175182530,3sleep01317511-21sort20:55:130
127504199533,9cyclictest1323737-21apt-get21:10:110
159199520,4rtkit-daemon1590-21rtkit-daemon22:10:130
14139542520,4sleep00-21swapper/023:11:140
14069222520,5sleep00-21swapper/023:01:280
159199490,4rtkit-daemon1590-21rtkit-daemon23:09:200
159199460,4rtkit-daemon1590-21rtkit-daemon22:57:171
159199420,4rtkit-daemon1590-21rtkit-daemon20:36:131
127504199412,14cyclictest1338940-21apt-get21:30:170
159199400,3rtkit-daemon0-21swapper/120:13:491
159199390,6rtkit-daemon1422501-21ssh23:24:131
159199390,4rtkit-daemon1371623-21http22:15:460
14693392390,2sleep11469314-21apt-get00:30:121
159199380,3rtkit-daemon1590-21rtkit-daemon20:02:071
159199370,5rtkit-daemon1590-21rtkit-daemon22:00:110
159199370,4rtkit-daemon0-21swapper/121:43:300
159199370,4rtkit-daemon0-21swapper/121:15:351
159199370,3rtkit-daemon1590-21rtkit-daemon23:41:210
159199370,3rtkit-daemon0-21swapper/121:50:031
14393152370,1sleep10-21swapper/123:46:181
14393152370,1sleep10-21swapper/123:46:171
159199360,4rtkit-daemon1590-21rtkit-daemon22:20:101
159199360,3rtkit-daemon0-21swapper/119:55:070
13349402360,4sleep00-21swapper/021:24:250
159199350,3rtkit-daemon0-21swapper/121:41:281
159199350,3rtkit-daemon0-21swapper/000:05:181
159199340,4rtkit-daemon1590-21rtkit-daemon23:54:441
159199340,4rtkit-daemon1590-21rtkit-daemon22:36:351
159199340,4rtkit-daemon1590-21rtkit-daemon00:11:281
159199340,3rtkit-daemon0-21swapper/120:36:420
159199340,3rtkit-daemon0-21swapper/120:27:341
127504199342,8cyclictest1461876-21apt-get00:20:100
159199330,4rtkit-daemon1590-21rtkit-daemon23:46:170
159199330,4rtkit-daemon1590-21rtkit-daemon23:46:160
159199330,4rtkit-daemon1590-21rtkit-daemon22:08:301
159199330,3rtkit-daemon1590-21rtkit-daemon21:57:281
159199330,3rtkit-daemon0-21swapper/122:04:191
159199330,3rtkit-daemon0-21swapper/119:51:091
159199330,3rtkit-daemon0-21swapper/100:28:160
159199320,4rtkit-daemon1590-21rtkit-daemon23:16:010
159199320,4rtkit-daemon1590-21rtkit-daemon20:45:010
159199320,3rtkit-daemon1590-21rtkit-daemon23:06:431
159199320,3rtkit-daemon1590-21rtkit-daemon00:21:491
159199320,3rtkit-daemon0-21swapper/121:58:110
159199320,3rtkit-daemon0-21swapper/121:53:230
159199320,3rtkit-daemon0-21swapper/119:16:050
1275041993220,6cyclictest1469259-40apt-check00:30:140
159199310,3rtkit-daemon1590-21rtkit-daemon00:05:040
159199310,3rtkit-daemon0-21swapper/123:25:010
159199310,3rtkit-daemon0-21swapper/122:44:570
159199310,3rtkit-daemon0-21swapper/120:16:170
159199310,3rtkit-daemon0-21swapper/120:16:160
159199310,3rtkit-daemon0-21swapper/120:06:380
159199310,3rtkit-daemon0-21swapper/100:37:070
159199310,3rtkit-daemon0-21swapper/023:59:221
159199310,3rtkit-daemon0-21swapper/022:12:211
159199310,3rtkit-daemon0-21swapper/020:58:321
159199300,3rtkit-daemon0-21swapper/122:31:500
159199300,3rtkit-daemon0-21swapper/019:35:381
159199300,3rtkit-daemon0-21swapper/000:04:431
159199290,4rtkit-daemon0-21swapper/123:30:040
159199290,3rtkit-daemon1590-21rtkit-daemon23:50:220
159199290,3rtkit-daemon1590-21rtkit-daemon21:04:391
159199290,3rtkit-daemon1590-21rtkit-daemon20:52:250
159199290,3rtkit-daemon0-21swapper/123:39:410
159199290,3rtkit-daemon0-21swapper/121:03:470
159199290,3rtkit-daemon0-21swapper/023:16:151
159199290,3rtkit-daemon0-21swapper/019:31:061
159199290,3rtkit-daemon0-21swapper/019:11:021
159199290,1rtkit-daemon1590-21rtkit-daemon22:17:581
159199290,1rtkit-daemon1590-21rtkit-daemon20:18:301
159199290,1rtkit-daemon1590-21rtkit-daemon20:18:291
159199280,3rtkit-daemon0-21swapper/121:29:270
159199280,3rtkit-daemon0-21swapper/119:42:330
159199280,3rtkit-daemon0-21swapper/020:43:141
159199270,4rtkit-daemon1590-21rtkit-daemon22:51:360
159199270,3rtkit-daemon0-21swapper/119:13:000
159199260,1rtkit-daemon1590-21rtkit-daemon23:59:430
127504699262,16cyclictest1315508-21apt-get20:50:131
1275046992617,5cyclictest2329154-21avahi-daemon21:45:111
127504699260,6cyclictest0-21swapper/121:26:181
159199250,1rtkit-daemon1590-21rtkit-daemon19:47:181
127504699254,16cyclictest1274988-21kworker/u8:319:15:141
127504699253,15cyclictest1342679-21apt-get21:35:121
127504199251,22cyclictest1404840-21awk23:00:000
159199240,1rtkit-daemon1590-21rtkit-daemon23:00:491
159199240,1rtkit-daemon1590-21rtkit-daemon19:41:451
159199240,1rtkit-daemon1590-21rtkit-daemon19:20:481
127504699243,14cyclictest1303454-21apt-get20:20:121
127504699242,16cyclictest1307350-21apt-get20:30:141
127504199242,14cyclictest1323260-40apt-check21:08:080
1275041992411,8cyclictest63950irq/130-enp2s022:35:140
127504199240,22cyclictest1331186-21python321:20:010
159199230,1rtkit-daemon1590-21rtkit-daemon00:03:250
127504699232,15cyclictest1472943-21apt-get00:35:121
127504699232,15cyclictest1313560-21apt-get20:45:141
127504699232,15cyclictest1281972-21apt-get19:25:131
127504199232,14cyclictest1280024-21apt-get19:20:130
1275041992310,7cyclictest63950irq/130-enp2s022:25:150
127504199230,5cyclictest0-21swapper/023:21:510
159199220,1rtkit-daemon1590-21rtkit-daemon20:07:561
127504699222,14cyclictest1394134-21apt-get22:45:121
127504699222,14cyclictest1379117-21apt-get22:25:071
1275046992216,4cyclictest1426434-21unin-run23:30:011
1275046992210,8cyclictest1396606-1kworker/u9:200:15:121
127504199222,14cyclictest1291729-21apt-get19:50:120
159199210,14rtkit-daemon0-21swapper/122:54:121
127504699217,9cyclictest1369712-1kworker/u9:122:40:101
127504699213,10cyclictest1334112-21apt-get21:22:331
127504199210,4cyclictest1313419-21wc20:45:000
127504199210,19cyclictest1379269-21sed22:25:010
127504199210,19cyclictest1346186-21latency_hist21:40:020
127504699201,14cyclictest1338913-21/usr/sbin/munin21:30:571
127504699201,14cyclictest1293676-21apt-get19:55:121
1275046992010,6cyclictest1323501-21diskmemload21:10:171
127504699200,5cyclictest14671792sh00:26:321
127504199200,18cyclictest1461688-21date00:19:590
127504199200,18cyclictest1394078-21ssh22:45:030
1275046991914,3cyclictest1384710-21sh22:30:451
127504199199,6cyclictest1323501-21diskmemload22:07:440
127504199198,8cyclictest1295842-21df20:00:140
127504199192,15cyclictest1307335-21find20:30:100
1275041991915,3cyclictest13-21ksoftirqd/019:30:000
1275041991911,6cyclictest1306716-21sshd20:25:310
1275041991910,7cyclictest1455868-21memory00:10:210
1275046991811,5cyclictest1430077-21seq23:34:561
1275046991810,4cyclictest1323501-21diskmemload23:43:291
1275046991810,4cyclictest1323501-21diskmemload23:10:231
127504199189,7cyclictest1303793-21perl20:20:170
127504199189,7cyclictest1300280-21ntpq20:10:230
127504199181,16cyclictest1350410-21tune2fs21:45:160
1275041991713,2cyclictest1285686-21dump-pmu-power19:35:010
127504199160,5cyclictest0-21swapper/019:45:220
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional