You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-16 - 11:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot4.osadl.org (updated Sun Jun 16, 2024 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9145892263183,28sleep10-21swapper/119:09:051
9131742256204,37sleep00-21swapper/019:05:210
10311102820,3sleep10-21swapper/122:40:541
10840212770,10sleep126-21ksoftirqd/123:55:271
10601942680,2sleep00-21swapper/023:22:140
159199620,3rtkit-daemon1590-21rtkit-daemon19:47:110
159199610,4rtkit-daemon1590-21rtkit-daemon22:28:211
159199480,4rtkit-daemon1590-21rtkit-daemon23:23:551
10405982460,4sleep126-21ksoftirqd/122:55:191
159199450,3rtkit-daemon1590-21rtkit-daemon22:32:350
9773932440,1sleep00-21swapper/021:28:560
159199390,3rtkit-daemon0-21swapper/000:35:040
159199380,6rtkit-daemon943522-21diskstats20:20:190
159199370,3rtkit-daemon0-21swapper/023:41:200
159199370,3rtkit-daemon0-21swapper/000:31:050
159199360,4rtkit-daemon1590-21rtkit-daemon21:47:061
159199360,3rtkit-daemon0-21swapper/121:54:560
159199350,4rtkit-daemon1590-21rtkit-daemon21:58:400
159199350,3rtkit-daemon0-21swapper/121:20:070
159199350,3rtkit-daemon0-21swapper/023:38:240
159199350,3rtkit-daemon0-21swapper/019:47:171
159199340,4rtkit-daemon1590-21rtkit-daemon23:25:411
159199340,4rtkit-daemon1590-21rtkit-daemon22:08:111
159199340,4rtkit-daemon1590-21rtkit-daemon20:57:301
159199340,4rtkit-daemon1590-21rtkit-daemon00:23:540
159199340,3rtkit-daemon0-21swapper/019:29:320
159199340,3rtkit-daemon0-21swapper/000:37:341
159199340,3rtkit-daemon0-21swapper/000:30:261
159199330,4rtkit-daemon1590-21rtkit-daemon20:36:291
159199330,4rtkit-daemon1590-21rtkit-daemon19:44:560
159199330,3rtkit-daemon0-21swapper/122:03:080
159199330,3rtkit-daemon0-21swapper/121:06:050
159199330,3rtkit-daemon0-21swapper/020:44:591
159199330,3rtkit-daemon0-21swapper/000:23:111
159199320,4rtkit-daemon1590-21rtkit-daemon23:01:181
159199320,4rtkit-daemon1590-21rtkit-daemon00:15:461
159199320,3rtkit-daemon1590-21rtkit-daemon19:24:121
159199320,3rtkit-daemon0-21swapper/123:08:190
159199320,3rtkit-daemon0-21swapper/122:25:430
159199320,3rtkit-daemon0-21swapper/122:15:371
159199320,3rtkit-daemon0-21swapper/020:46:431
159199320,3rtkit-daemon0-21swapper/020:08:551
91479599312,23cyclictest945567-40apt-check20:25:140
159199310,4rtkit-daemon1590-21rtkit-daemon23:07:361
159199310,4rtkit-daemon1590-21rtkit-daemon22:07:420
159199310,3rtkit-daemon0-21swapper/121:35:080
159199310,3rtkit-daemon0-21swapper/120:16:160
159199310,3rtkit-daemon0-21swapper/100:08:550
159199310,3rtkit-daemon0-21swapper/019:30:041
159199310,3rtkit-daemon0-21swapper/000:28:071
91480099303,21cyclictest1075908-21apt-get23:45:141
159199300,4rtkit-daemon1590-21rtkit-daemon22:48:251
159199300,4rtkit-daemon1590-21rtkit-daemon19:55:300
159199300,3rtkit-daemon1590-21rtkit-daemon23:48:340
159199300,3rtkit-daemon1590-21rtkit-daemon21:23:471
159199300,3rtkit-daemon0-21swapper/019:57:441
91480099290,8cyclictest26-21ksoftirqd/122:30:171
159199290,4rtkit-daemon1590-21rtkit-daemon23:02:340
159199290,4rtkit-daemon1590-21rtkit-daemon21:48:250
159199290,3rtkit-daemon0-21swapper/123:25:060
159199290,3rtkit-daemon0-21swapper/121:18:120
159199290,3rtkit-daemon0-21swapper/020:11:501
159199280,4rtkit-daemon1590-21rtkit-daemon19:50:571
159199280,3rtkit-daemon1590-21rtkit-daemon23:56:340
159199280,3rtkit-daemon0-21swapper/120:49:000
159199280,3rtkit-daemon0-21swapper/023:38:571
159199280,3rtkit-daemon0-21swapper/022:37:431
159199280,3rtkit-daemon0-21swapper/021:58:271
159199270,4rtkit-daemon1590-21rtkit-daemon21:33:590
159199270,22rtkit-daemon1014760-21apt-get22:20:130
91479599262,19cyclictest963394-21/usr/sbin/munin21:10:360
914800992512,8cyclictest963330-1kworker/u9:023:50:131
91479599253,15cyclictest1036634-21apt-get22:50:120
159199250,1rtkit-daemon1590-21rtkit-daemon21:38:481
159199250,1rtkit-daemon1590-21rtkit-daemon21:33:001
159199250,1rtkit-daemon1590-21rtkit-daemon21:05:311
159199250,1rtkit-daemon1590-21rtkit-daemon19:30:450
914795992418,3cyclictest931765-21/usr/sbin/munin19:50:250
914795992417,5cyclictest1051523-21irqstats23:10:210
91479599240,7cyclictest1087044-21/usr/sbin/munin00:00:200
159199240,4rtkit-daemon1590-21rtkit-daemon22:59:310
159199240,4rtkit-daemon1590-21rtkit-daemon22:41:000
159199240,1rtkit-daemon1590-21rtkit-daemon22:20:071
159199240,1rtkit-daemon1590-21rtkit-daemon20:30:030
159199240,1rtkit-daemon1590-21rtkit-daemon00:07:291
159199240,19rtkit-daemon914788-21cyclictest22:15:580
9522522230,6sleep00-21swapper/020:40:240
91480099233,13cyclictest947141-21check-new-relea20:27:261
91480099232,14cyclictest943304-21apt-get20:20:141
914800992318,3cyclictest26-21ksoftirqd/120:00:011
914800992313,7cyclictest1054648-21apt-get23:15:151
91480099230,7cyclictest966762-21ssh21:14:351
91480099230,6cyclictest0-21swapper/119:10:061
91480099230,5cyclictest0-21swapper/119:17:371
91479599238,6cyclictest0-21swapper/023:19:500
914795992313,7cyclictest63950irq/130-enp2s000:10:140
914795992311,7cyclictest63950irq/130-enp2s000:15:140
159199230,1rtkit-daemon1590-21rtkit-daemon21:18:321
159199230,1rtkit-daemon1590-21rtkit-daemon20:05:340
91480099229,8cyclictest1000022-21apt-get22:00:131
91480099222,13cyclictest1065198-21apt-get23:30:121
914800992213,5cyclictest1093379-21kworker/u8:300:10:131
91480099221,18cyclictest963141-21diskmemload21:42:391
91479599224,16cyclictest1010892-21cat22:15:010
914795992217,3cyclictest925598-21fschecks_time19:35:180
91479599221,15cyclictest917459-21apt-get19:15:130
91480099219,10cyclictest1087410-21needreboot00:00:241
91480099213,10cyclictest992676-21apt-get21:50:161
91480099212,13cyclictest1072303-21apt-get23:40:121
91480099211,6cyclictest1009849-21ssh22:13:001
91479599217,3cyclictest141rcu_preempt22:49:590
91479599212,14cyclictest1025938-21apt-get22:35:130
91479599212,13cyclictest914935-21apt-get19:10:130
914795992112,5cyclictest963141-21diskmemload23:34:150
914795992111,7cyclictest935361-21apt-get20:00:120
91479599210,19cyclictest1105595-21ntp_states00:25:240
159199210,13rtkit-daemon0-21swapper/119:25:231
914800992016,3cyclictest26-21ksoftirqd/119:40:001
914800992013,5cyclictest974954-21tail21:25:191
91479599204,9cyclictest949650-21apt-get20:35:120
91479599203,9cyclictest957474-21apt-get20:55:140
91479599203,10cyclictest919433-21apt-get19:20:110
91479599202,13cyclictest959443-21apt-get21:00:120
91479599200,17cyclictest955524-21apt-get20:50:140
159199200,13rtkit-daemon0-21swapper/120:53:391
159199200,13rtkit-daemon0-21swapper/120:15:411
159199200,12rtkit-daemon0-21swapper/020:11:430
91480099199,8cyclictest960489-21cat21:00:301
91480099196,7cyclictest1053525-21seq23:13:081
91480099191,12cyclictest927262-21apt-get19:40:151
91479599192,12cyclictest1080423-21ntp_states23:50:300
914795991914,4cyclictest3143951-21snmpd21:40:240
91480099181,12cyclictest947681-21/usr/sbin/munin20:30:381
91480099179,6cyclictest1037029-21fw_packets22:50:221
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:533
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
none09:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional