You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-27 - 05:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6.osadl.org (updated Wed Aug 27, 2025 00:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1800421030,5chrt18005-21/usr/sbin/munin22:40:291
683828830,46sleep10-21swapper/119:05:361
307732880,10sleep130776-21latency_hist20:15:011
615828430,39sleep00-21swapper/019:05:250
7444998156,9cyclictest26-21ksoftirqd/122:20:501
49902780,11sleep14992-21cstates23:35:191
7444997325,32cyclictest26-21ksoftirqd/119:20:461
7440996925,39cyclictest14-21ksoftirqd/021:25:330
7440996823,40cyclictest11037-21seq19:16:470
7440996823,29cyclictest9711-21sshd23:48:360
7440996823,29cyclictest9711-21sshd23:48:360
7444996639,12cyclictest26-21ksoftirqd/120:25:231
7440996635,10cyclictest14-21ksoftirqd/022:31:240
7440996634,26cyclictest14-21ksoftirqd/020:30:330
7440996541,18cyclictest14-21ksoftirqd/019:35:350
7440996533,25cyclictest14-21ksoftirqd/023:00:360
7440996533,25cyclictest14-21ksoftirqd/021:50:420
7440996531,12cyclictest14-21ksoftirqd/021:56:170
7440996525,15cyclictest14-21ksoftirqd/000:25:360
7444996435,17cyclictest0-21swapper/121:45:111
7440996437,22cyclictest14-21ksoftirqd/019:10:290
7440996427,31cyclictest14-21ksoftirqd/022:06:190
7444996338,15cyclictest26-21ksoftirqd/120:00:141
744099637,40cyclictest0-21swapper/021:21:360
7440996337,20cyclictest420-21dbus-daemon21:05:000
7440996335,22cyclictest14-21ksoftirqd/022:25:200
7440996334,8cyclictest14-21ksoftirqd/022:45:030
7440996332,25cyclictest14-21ksoftirqd/023:35:250
7440996332,25cyclictest14-21ksoftirqd/021:30:170
7440996326,31cyclictest14-21ksoftirqd/023:22:400
7440996232,24cyclictest14-21ksoftirqd/020:05:360
7440996231,25cyclictest14-21ksoftirqd/019:40:380
744499615,52cyclictest0-21swapper/123:14:451
744499615,52cyclictest0-21swapper/123:14:451
7444996136,20cyclictest26-21ksoftirqd/122:05:141
7440996144,10cyclictest14-21ksoftirqd/000:10:320
7440996138,17cyclictest14-21ksoftirqd/021:45:010
7440996137,9cyclictest14-21ksoftirqd/020:15:260
7440996133,23cyclictest14-21ksoftirqd/000:15:320
7440996132,17cyclictest14-21ksoftirqd/020:25:470
7440996132,13cyclictest14-21ksoftirqd/020:40:220
7440996129,26cyclictest14-21ksoftirqd/023:30:240
7440996128,11cyclictest14-21ksoftirqd/021:45:220
7440996128,11cyclictest14-21ksoftirqd/021:35:360
7440996128,11cyclictest14-21ksoftirqd/021:35:360
7440996128,11cyclictest14-21ksoftirqd/019:30:390
744499603,50cyclictest251rcuc/100:40:001
744499603,50cyclictest251rcuc/100:40:001
7444996010,46cyclictest36-21kcompactd021:05:161
7440996037,9cyclictest14-21ksoftirqd/022:56:360
7440996036,17cyclictest14-21ksoftirqd/023:20:010
7440996029,24cyclictest14-21ksoftirqd/019:55:290
7440996027,11cyclictest14-21ksoftirqd/022:20:250
744499593,18cyclictest24661-21runrttasks22:59:521
7444995927,26cyclictest26-21ksoftirqd/123:20:171
7444995912,42cyclictest0-21swapper/123:25:421
744099596,48cyclictest0-21swapper/022:50:160
7440995944,10cyclictest14-21ksoftirqd/022:15:300
7440995938,16cyclictest14-21ksoftirqd/022:10:180
7440995936,9cyclictest14-21ksoftirqd/020:55:350
7440995936,18cyclictest14-21ksoftirqd/023:25:290
7440995936,17cyclictest14-21ksoftirqd/020:35:370
7440995936,17cyclictest14-21ksoftirqd/019:50:350
7440995936,17cyclictest14-21ksoftirqd/000:00:190
7440995935,18cyclictest14-21ksoftirqd/023:50:370
7440995935,18cyclictest14-21ksoftirqd/019:25:030
7440995930,12cyclictest14-21ksoftirqd/023:55:170
7440995928,25cyclictest14-21ksoftirqd/022:35:260
7440995928,25cyclictest14-21ksoftirqd/019:45:230
7440995927,25cyclictest14-21ksoftirqd/020:00:340
7440995925,27cyclictest14-21ksoftirqd/021:05:310
7440995922,31cyclictest14-21ksoftirqd/022:45:020
7444995831,16cyclictest0-21swapper/122:00:171
7440995843,9cyclictest14-21ksoftirqd/020:10:340
7440995842,10cyclictest14-21ksoftirqd/000:20:150
7440995842,10cyclictest14-21ksoftirqd/000:20:150
7440995836,17cyclictest14-21ksoftirqd/019:23:030
7440995835,9cyclictest14-21ksoftirqd/000:35:240
7440995835,9cyclictest14-21ksoftirqd/000:35:240
7440995835,17cyclictest14-21ksoftirqd/023:05:200
7440995834,18cyclictest14-21ksoftirqd/000:30:190
744499573,48cyclictest21872-21runrttasks19:49:531
7444995733,18cyclictest26-21ksoftirqd/100:20:141
7444995733,18cyclictest26-21ksoftirqd/100:20:141
7444995728,16cyclictest0-21swapper/121:30:151
7444995725,22cyclictest2975-21apt-get23:30:121
7440995742,9cyclictest14-21ksoftirqd/021:15:250
7440995734,17cyclictest14-21ksoftirqd/022:00:230
7440995734,17cyclictest14-21ksoftirqd/021:10:170
7440995733,18cyclictest14-21ksoftirqd/023:10:210
7440995733,18cyclictest14-21ksoftirqd/023:10:210
7440995733,17cyclictest14-21ksoftirqd/000:05:130
7440995732,19cyclictest14-21ksoftirqd/020:20:300
7440995725,9cyclictest9441-21telnet20:45:220
744499564,45cyclictest29815-21python321:40:381
7444995637,13cyclictest22028-21telnet21:20:181
744499563,47cyclictest16594-21chrt00:07:101
7444995627,16cyclictest26-21ksoftirqd/120:45:191
7444995626,17cyclictest0-21swapper/119:40:141
7444995619,32cyclictest26-21ksoftirqd/120:35:051
7444995613,16cyclictest0-21swapper/100:30:141
7440995633,17cyclictest14-21ksoftirqd/020:50:180
7440995628,22cyclictest14-21ksoftirqd/023:40:310
744499555,19cyclictest11017-21apt-get20:50:161
744499553,18cyclictest27988-21sshd23:07:561
744499553,17cyclictest16136-21gpgv21:05:011
744499553,17cyclictest1528-21seq21:54:351
744499553,16cyclictest9737-21diskstats19:15:091
744499553,15cyclictest9520-21ntp_states22:15:311
7444995529,15cyclictest0-21swapper/100:00:131
7444995528,18cyclictest14384-21date21:00:011
744499544,11cyclictest31192-21diskstats20:15:241
7444995438,10cyclictest26-21ksoftirqd/121:35:161
7444995438,10cyclictest26-21ksoftirqd/121:35:161
744499543,45cyclictest31827-21latency_hist23:20:021
744499543,17cyclictest15213-21runrttasks22:30:521
65572542,17sleep16635-21telnet23:40:211
7444995338,9cyclictest26-21ksoftirqd/120:40:191
7444995338,10cyclictest26-21ksoftirqd/120:30:191
7444995338,10cyclictest16519-21ntpq22:35:331
7444995337,11cyclictest514-21snmpd19:10:291
744499533,45cyclictest9059-21proc_pri23:45:381
744499533,45cyclictest9059-21proc_pri23:45:381
7444995327,13cyclictest0-21swapper/120:05:151
7444995314,26cyclictest18193-21diskmemload21:10:131
7444995310,39cyclictest0-21swapper/119:30:191
744499526,11cyclictest0-21swapper/122:13:561
744499526,10cyclictest0-21swapper/122:25:281
744499524,12cyclictest19635-21apt-get22:45:121
7444995237,9cyclictest26-21ksoftirqd/123:50:321
7444995237,9cyclictest26-21ksoftirqd/121:19:201
7444995236,10cyclictest26-21ksoftirqd/119:35:291
7444995235,10cyclictest26-21ksoftirqd/121:55:181
744499515,41cyclictest0-21swapper/119:25:201
7444995137,9cyclictest26-21ksoftirqd/119:55:211
7444995137,9cyclictest26-21ksoftirqd/100:10:261
7444995136,9cyclictest26-21ksoftirqd/100:15:371
744499513,43cyclictest21725-21diskstats22:50:231
7444995120,26cyclictest23658-21aten2.4_r3power21:25:181
7444995118,20cyclictest0-21swapper/119:50:141
7444995035,9cyclictest26-21ksoftirqd/123:56:391
7444995035,9cyclictest26-21ksoftirqd/123:00:251
7444995035,10cyclictest26-21ksoftirqd/100:25:341
7444995019,18cyclictest0-21swapper/120:20:141
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional