You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-17 - 19:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6.osadl.org (updated Wed Sep 17, 2025 12:45:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
106912980,25sleep1251rcuc/112:25:011
2762329416,31sleep10-21swapper/107:09:571
27765999165,14cyclictest14-21ksoftirqd/010:10:130
27765998632,47cyclictest32396-21apt-get11:55:130
27765998153,18cyclictest853-21apt-get10:25:140
27765998143,27cyclictest30000-21apt-get08:45:140
27765997952,17cyclictest18915-21apt-get09:45:130
27765997850,18cyclictest17182-21apt-get09:40:160
27765997744,23cyclictest22966-21apt-get08:25:140
243932770,9sleep10-21swapper/111:30:351
243932770,9sleep10-21swapper/111:30:341
27765997648,14cyclictest21887-21apt-get11:25:160
27765997647,15cyclictest8355-21apt-get07:45:140
27765997647,15cyclictest8355-21apt-get07:45:130
27765997646,15cyclictest11888-21apt-get09:25:130
27765997644,20cyclictest27174-21apt-get11:40:150
27765997546,20cyclictest19463-21apt-get08:15:230
27765997544,16cyclictest18383-21apt-get11:15:140
27765997543,23cyclictest15364-21apt-get09:35:110
27765997543,19cyclictest22390-21apt-get09:55:130
27765997542,21cyclictest21229-21apt-get08:20:150
27765997527,19cyclictest29801-21cstates10:15:210
27765997447,17cyclictest14-21ksoftirqd/009:00:140
27765997445,18cyclictest11365-21apt-get10:55:140
27765997444,14cyclictest7886-21apt-get10:45:130
27765997443,15cyclictest25941-21apt-get10:05:140
27765997439,20cyclictest2922-21apt-get07:30:150
27765997439,20cyclictest24204-21apt-get10:00:140
27765997345,17cyclictest14-21ksoftirqd/008:30:100
27765997344,16cyclictest31868-21apt-get07:20:130
27765997341,20cyclictest5255-21apt-get12:10:130
27765997340,26cyclictest0-21swapper/008:10:150
27765997339,24cyclictest4657-21apt-get07:35:140
27765997313,54cyclictest0-21swapper/009:30:150
27765997245,14cyclictest6649-21apt-get09:10:130
27765997244,15cyclictest13124-21apt-get11:00:150
27765997242,15cyclictest12842-21apt-get12:30:130
27765997239,21cyclictest14862-21apt-get11:05:160
2737927215,48sleep00-21swapper/007:07:510
27765997150,9cyclictest31738-21apt-get08:50:130
27765997150,9cyclictest31738-21apt-get08:50:120
27765997148,10cyclictest10155-21apt-get09:20:160
27765997143,12cyclictest25365-21apt-get11:35:160
27765997142,14cyclictest14583-21apt-get12:35:160
27765997044,13cyclictest2597-21apt-get10:30:150
27765997043,14cyclictest8385-21apt-get09:15:130
27765997042,15cyclictest20654-21apt-get09:50:140
27770996928,9cyclictest26-21ksoftirqd/110:20:091
27765996943,13cyclictest9062-21apt-get12:20:140
27765996941,14cyclictest16648-21apt-get11:10:140
27765996844,15cyclictest26447-21apt-get08:35:160
27765996742,20cyclictest14-21ksoftirqd/012:10:000
27765996741,14cyclictest4335-21apt-get10:35:160
27765996741,13cyclictest15633-21apt-get08:05:140
27765996741,13cyclictest1350-21apt-get08:55:240
27765996741,13cyclictest1350-21apt-get08:55:230
27765996640,14cyclictest20145-21apt-get11:20:130
27765996640,13cyclictest30107-21apt-get07:15:140
27765996638,23cyclictest0-21swapper/010:20:260
27765996635,23cyclictest0-21swapper/009:05:170
27765996623,36cyclictest8181-21munin-run07:45:000
111322660,5sleep1251rcuc/109:20:391
27765996540,13cyclictest1180-21apt-get07:25:150
27765996537,22cyclictest0-21swapper/008:00:240
27765996536,16cyclictest11832-21apt-get07:55:140
27765996520,40cyclictest3304-21idleruntime-cro12:05:000
2777099648,23cyclictest26-21ksoftirqd/111:00:021
27770996414,31cyclictest23253-21awk09:55:371
27765996436,22cyclictest0-21swapper/007:10:130
27765996436,19cyclictest0-21swapper/010:50:130
27765996435,21cyclictest0-21swapper/010:40:150
27770996320,10cyclictest26-21ksoftirqd/112:15:091
27770996314,31cyclictest553-21runrttasks11:43:561
27765996339,13cyclictest7294-21apt-get12:15:240
2777099629,42cyclictest26-21ksoftirqd/107:34:361
27770996215,19cyclictest251rcuc/109:04:191
27770996215,19cyclictest251rcuc/108:59:211
27770996215,19cyclictest251rcuc/108:59:201
27770996213,25cyclictest553-21runrttasks12:34:111
27765996239,12cyclictest28266-21apt-get08:40:170
27765996233,19cyclictest30661-21apt-get11:50:180
27765996233,19cyclictest30661-21apt-get11:50:170
27765996212,20cyclictest0-21swapper/012:25:290
27770996125,14cyclictest26-21ksoftirqd/111:50:201
27770996125,14cyclictest26-21ksoftirqd/111:50:201
27770996115,19cyclictest251rcuc/111:37:431
27770996113,42cyclictest251rcuc/111:48:221
27765996136,13cyclictest10096-21apt-get07:50:150
27765996112,20cyclictest0-21swapper/011:30:210
27765996112,20cyclictest0-21swapper/011:30:200
2777099606,37cyclictest9549-21cat10:50:011
27770996039,8cyclictest151rcu_preempt10:35:221
27770996025,30cyclictest0-21swapper/107:50:001
27770996025,30cyclictest0-21swapper/107:50:001
27770996018,23cyclictest26-21ksoftirqd/107:10:361
27770996015,40cyclictest0-21swapper/107:38:051
27770996014,40cyclictest251rcuc/109:39:521
27770996014,20cyclictest251rcuc/110:09:321
27770996013,19cyclictest251rcuc/108:43:221
27765996013,18cyclictest0-21swapper/011:45:150
27770995917,37cyclictest26-21ksoftirqd/111:55:351
27770995917,37cyclictest26-21ksoftirqd/107:15:311
27770995915,38cyclictest251rcuc/109:42:221
27770995914,19cyclictest251rcuc/108:49:481
27770995913,11cyclictest0-21swapper/108:15:201
2777099589,22cyclictest26-21ksoftirqd/107:25:181
2777099589,16cyclictest26-21ksoftirqd/108:55:001
2777099589,16cyclictest26-21ksoftirqd/108:54:591
2777099589,15cyclictest26-21ksoftirqd/110:10:141
2777099588,17cyclictest26-21ksoftirqd/108:20:311
2777099586,17cyclictest26-21ksoftirqd/108:25:311
2777099585,17cyclictest26-21ksoftirqd/110:15:161
27770995814,38cyclictest251rcuc/110:01:061
27770995814,38cyclictest251rcuc/109:45:561
27770995814,10cyclictest26-21ksoftirqd/112:35:181
27770995813,40cyclictest0-21swapper/110:25:351
2777099578,16cyclictest26-21ksoftirqd/111:25:341
27770995714,11cyclictest251rcuc/112:13:411
27770995711,41cyclictest0-21swapper/108:09:471
2777099567,9cyclictest12149-21grep09:25:191
2777099566,17cyclictest26-21ksoftirqd/108:30:251
2777099565,14cyclictest26-21ksoftirqd/109:15:341
27770995615,19cyclictest251rcuc/110:31:381
27770995610,19cyclictest251rcuc/110:40:491
27770995610,15cyclictest26-21ksoftirqd/109:05:361
27770995610,13cyclictest151rcu_preempt11:12:261
2777099559,15cyclictest26-21ksoftirqd/107:20:231
2777099559,14cyclictest26-21ksoftirqd/111:09:591
2777099555,17cyclictest26-21ksoftirqd/107:40:211
2777099555,16cyclictest26-21ksoftirqd/109:30:231
2777099553,17cyclictest26-21ksoftirqd/109:50:391
27770995518,19cyclictest6986-21df_inode09:10:221
27770995516,19cyclictest11367-21grep12:25:291
27770995515,20cyclictest11831-21apt07:55:131
27770995515,19cyclictest26561-21/usr/sbin/munin08:35:181
27770995514,18cyclictest10429-21df07:50:211
27770995514,10cyclictest251rcuc/112:07:371
27770995510,14cyclictest26-21ksoftirqd/108:00:341
2777099549,15cyclictest26-21ksoftirqd/111:15:221
2777099546,15cyclictest26-21ksoftirqd/111:20:151
2777099545,16cyclictest26-21ksoftirqd/110:50:211
27770995437,11cyclictest0-21swapper/111:00:221
27770995414,11cyclictest251rcuc/108:15:001
27770995315,18cyclictest2076-21diskstats12:00:221
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:353
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
none12:16:352
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional