You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-05 - 04:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackcslot2.osadl.org (updated Mon May 05, 2025 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1635027158,9sleep00-21swapper/019:04:280
1651026955,9sleep10-21swapper/119:06:081
99862650,0sleep00-21swapper/023:28:550
99862650,0sleep00-21swapper/023:28:550
16897994110,30cyclictest0-21swapper/120:27:331
16897993636,0cyclictest0-21swapper/123:25:281
16897993020,6cyclictest16293-21apache200:31:591
1689799301,1cyclictest91rcu_preempt23:48:181
16896993010,18cyclictest0-21swapper/022:51:200
1689799290,3cyclictest91rcu_preempt20:33:321
1689799290,25cyclictest0-21swapper/123:03:371
16896992819,6cyclictest30445-21diskmemload00:14:290
1689699280,1cyclictest0-21swapper/000:31:140
16897992726,1cyclictest24-21ksoftirqd/122:48:301
16897992726,0cyclictest24-21ksoftirqd/123:08:311
16897992725,1cyclictest16514-21df_inode22:13:331
16897992724,1cyclictest24-21ksoftirqd/122:34:001
16896992710,12cyclictest0-21swapper/023:22:440
16897992624,1cyclictest24-21ksoftirqd/100:09:521
1689799262,2cyclictest91rcu_preempt21:10:331
16897992610,2cyclictest0-21swapper/123:55:571
1689699260,17cyclictest30445-21diskmemload22:33:440
1689799252,4cyclictest91rcu_preempt22:02:171
16897992524,0cyclictest24-21ksoftirqd/121:47:091
1689799250,22cyclictest0-21swapper/122:43:441
16896992520,4cyclictest0-21swapper/023:41:440
16897992424,0cyclictest24-21ksoftirqd/122:18:321
16897992424,0cyclictest0-21swapper/119:26:081
16897992422,1cyclictest24-21ksoftirqd/121:51:081
16897992419,3cyclictest24-21ksoftirqd/100:13:371
16897992418,3cyclictest24-21ksoftirqd/100:33:281
16897992413,3cyclictest24-21ksoftirqd/120:38:381
1689799241,12cyclictest91rcu_preempt00:27:151
16896992422,1cyclictest13202-21ssh21:27:120
16896992419,1cyclictest7-21ksoftirqd/020:33:320
16896992417,6cyclictest17479-21ssh22:57:360
16896992410,6cyclictest0-21swapper/023:55:010
16896992410,3cyclictest0-21swapper/022:31:280
1689799232,12cyclictest0-21swapper/120:11:521
16897992318,2cyclictest24-21ksoftirqd/123:28:371
16897992318,2cyclictest24-21ksoftirqd/123:28:371
16897992317,2cyclictest24-21ksoftirqd/121:23:411
16897992316,4cyclictest16293-21apache222:08:381
16897992315,3cyclictest24-21ksoftirqd/121:18:341
1689799230,3cyclictest91rcu_preempt22:03:391
1689799230,17cyclictest30445-21diskmemload00:08:101
1689699237,15cyclictest0-21swapper/000:23:490
16896992321,1cyclictest7-21ksoftirqd/021:33:300
16896992315,7cyclictest16293-21apache219:33:470
16896992313,5cyclictest97850irq/107-eth1-rx23:08:350
16896992312,4cyclictest0-21swapper/021:43:300
16896992311,8cyclictest9959-21ssh21:23:090
16896992310,8cyclictest0-21swapper/019:23:400
1689699230,1cyclictest0-21swapper/000:04:500
1689799229,7cyclictest91rcu_preempt19:13:381
1689799228,1cyclictest91rcu_preempt20:43:371
1689799223,4cyclictest91rcu_preempt20:53:361
1689799222,2cyclictest91rcu_preempt00:18:431
16897992222,0cyclictest24-21ksoftirqd/121:32:521
1689799222,16cyclictest0-21swapper/120:03:431
16897992221,1cyclictest24-21ksoftirqd/123:58:561
16897992220,1cyclictest24-21ksoftirqd/119:51:251
16897992217,3cyclictest231ktimersoftd/119:33:181
1689799221,3cyclictest91rcu_preempt19:38:381
1689799220,1cyclictest91rcu_preempt23:38:571
1689799220,19cyclictest0-21swapper/120:17:411
16896992210,6cyclictest0-21swapper/023:43:390
16896992210,6cyclictest0-21swapper/022:04:470
16896992210,1cyclictest0-21swapper/023:03:330
1689699220,15cyclictest11514-21kworker/u4:021:28:350
16897992118,1cyclictest0-21swapper/119:35:361
16897992117,2cyclictest24-21ksoftirqd/123:18:021
16897992116,1cyclictest0-21swapper/122:53:391
16897992115,4cyclictest24-21ksoftirqd/122:38:351
16897992111,3cyclictest30445-21diskmemload21:16:401
16897992110,6cyclictest0-21swapper/121:53:341
16897992110,2cyclictest0-21swapper/122:23:321
1689799210,1cyclictest0-21swapper/120:48:561
16896992117,2cyclictest16894-21cyclictest21:57:410
16896992117,2cyclictest16293-21apache200:20:060
16896992116,4cyclictest0-21swapper/022:46:530
1689699211,3cyclictest0-21swapper/021:08:380
16896992113,3cyclictest0-21swapper/021:48:370
16896992111,8cyclictest8983-21sh00:10:430
16896992111,5cyclictest0-21swapper/023:27:010
16896992110,7cyclictest0-21swapper/021:15:330
16896992110,6cyclictest0-21swapper/021:38:510
16896992110,6cyclictest0-21swapper/019:48:360
16896992110,5cyclictest0-21swapper/022:01:400
16896992110,1cyclictest0-21swapper/023:33:290
16896992110,0cyclictest0-21swapper/022:10:000
1689699210,20cyclictest0-21swapper/022:59:370
1689699210,20cyclictest0-21swapper/022:13:490
2085222010,0sleep10-21swapper/123:01:551
1689799204,5cyclictest0-21swapper/123:48:361
1689799203,2cyclictest91rcu_preempt22:29:251
1689799202,2cyclictest91rcu_preempt19:21:231
16897992019,0cyclictest0-21swapper/121:38:331
16897992010,7cyclictest0-21swapper/123:36:351
16897992010,6cyclictest0-21swapper/123:18:241
1689699202,16cyclictest0-21swapper/023:59:220
16896992018,1cyclictest7-21ksoftirqd/022:23:170
16896992016,3cyclictest81ktimersoftd/019:58:320
16896992011,3cyclictest0-21swapper/019:28:310
16896992010,6cyclictest0-21swapper/000:36:120
16897991914,4cyclictest16293-21apache221:35:111
16897991914,2cyclictest24-21ksoftirqd/120:18:421
16897991910,5cyclictest0-21swapper/119:43:371
16897991910,2cyclictest15212-21/usr/sbin/munin20:28:371
16896991918,1cyclictest817-21apache220:14:310
16896991918,1cyclictest0-21swapper/021:07:230
16896991918,0cyclictest7-21ksoftirqd/020:43:340
16896991918,0cyclictest7-21ksoftirqd/020:28:170
16896991912,3cyclictest16293-21apache219:45:120
1689699191,16cyclictest0-21swapper/022:40:460
16896991910,4cyclictest0-21swapper/020:08:340
16896991910,1cyclictest0-21swapper/019:15:020
3003521810,1sleep10-21swapper/121:04:101
16897991810,4cyclictest0-21swapper/119:08:301
1689699186,8cyclictest30445-21diskmemload23:13:290
1689699182,8cyclictest2013-21diskstats19:53:320
1689699182,8cyclictest2013-21diskstats19:53:320
1689699181,3cyclictest91rcu_preempt20:48:340
16896991810,4cyclictest0-21swapper/022:23:400
16896991810,3cyclictest23915-21apache_volume23:48:310
16897991715,2cyclictest692-21ntpd19:57:021
16897991715,2cyclictest692-21ntpd19:57:021
16897991715,1cyclictest3722-21apache_accesses19:58:321
1689699174,8cyclictest0-21swapper/019:08:320
1689699174,1cyclictest6415-21taskset20:03:410
1689699173,8cyclictest0-21swapper/019:18:340
16896991715,1cyclictest28898-21if_eth019:38:320
16896991710,4cyclictest0-21swapper/020:24:010
16896991710,2cyclictest0-21swapper/020:38:340
1689799169,5cyclictest231ktimersoftd/120:58:301
16896991612,2cyclictest11396-21apache_volume20:18:330
1689699153,7cyclictest0-21swapper/021:00:520
16896991510,3cyclictest0-21swapper/020:53:370
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional