You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 16:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat Dec 06, 2025 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8416312800,6sleep20-21swapper/212:31:132
519758996352,8cyclictest736211-21latency_hist10:45:010
5812402620,2chrt586-21kworker/3:2+events08:10:013
6598192570,2sleep3471rcuc/309:26:143
519764995753,3cyclictest696129-21kworker/u8:2+flush-8:012:26:192
7297142550,1sleep0729717-21cut10:36:140
519764995551,3cyclictest519933-21kworker/u8:1+flush-8:007:41:222
519764995550,4cyclictest3880451-21kworker/u8:3+flush-8:007:31:232
519764995544,4cyclictest581250-21kworker/u8:0+events_unbound08:51:142
519760995544,9cyclictest665145-21ntpq09:31:221
519764995449,4cyclictest519933-21kworker/u8:1+events_unbound08:11:182
519760995443,9cyclictest690292-21ntpq09:56:141
519758995448,5cyclictest781228-21anacron11:31:070
519764995349,3cyclictest611002-21kworker/u8:4+events_unbound08:41:212
519758995345,5cyclictest835334-21latency_hist12:25:010
519764995147,3cyclictest3880451-21kworker/u8:3+flush-8:007:21:182
519764995146,4cyclictest696129-21kworker/u8:2+flush-8:011:11:252
519764995146,4cyclictest635593-21kworker/u8:1+flush-8:009:11:212
519760995142,6cyclictest741142-21latency_hist10:50:001
519764995045,4cyclictest696129-21kworker/u8:2+flush-8:010:21:222
519764994945,3cyclictest581250-21kworker/u8:0+events_unbound09:31:272
519760994943,4cyclictest696129-21kworker/u8:2+events_unbound10:11:251
519760994840,5cyclictest519933-21kworker/u8:1+events_unbound07:46:211
519764994741,4cyclictest696129-21kworker/u8:2+flush-8:011:31:132
519760994636,8cyclictest696129-21kworker/u8:2+flush-8:012:36:341
519760994636,8cyclictest535675-21ntpq07:21:161
519758994636,8cyclictest599964-21ntpq08:26:160
519764994541,3cyclictest581250-21kworker/u8:0+flush-8:009:01:132
519764994540,4cyclictest3880451-21kworker/u8:3+flush-8:007:51:222
519764994537,6cyclictest671603-21cat09:40:012
519760994539,4cyclictest581250-21kworker/u8:0+flush-8:008:56:241
519760994537,5cyclictest519933-21kworker/u8:1+flush-8:008:26:081
519758994540,2cyclictest584-21snmpd07:56:190
519760994436,5cyclictest519933-21kworker/u8:1+events_unbound07:36:161
519760994434,8cyclictest644640-21ntpq09:11:171
519760994434,7cyclictest282-21systemd-journal08:55:001
519760994433,5cyclictest676381-21latency_hist09:45:001
519758994433,8cyclictest282-21systemd-journal11:15:000
5653702430,2sleep10-21swapper/107:51:171
519760994337,4cyclictest706486-21kworker/u8:3+flush-8:010:26:141
519760994334,6cyclictest845202-21latency_hist12:35:011
519758994335,6cyclictest655644-21apt-get09:25:000
519758994335,6cyclictest630603-21latency_hist09:00:010
7188622420,3sleep3586-21kworker/3:2+events10:26:143
519760994235,5cyclictest581250-21kworker/u8:0+flush-8:008:21:211
519758994233,6cyclictest701070-21latency_hist10:10:010
519760994136,3cyclictest581250-21kworker/u8:0+events_unbound09:16:111
519760994135,4cyclictest696129-21kworker/u8:2+events_unbound11:26:351
519758994133,5cyclictest681288-21latency_hist09:50:010
519758994130,9cyclictest769879-21ntpq11:16:150
519764993934,3cyclictest591143-21kworker/u8:2+events_unbound08:46:082
519760993934,4cyclictest519933-21kworker/u8:1+flush-8:008:06:071
519760993933,4cyclictest282-21systemd-journal08:16:341
519760993930,7cyclictest519408-21apt-get07:10:021
519760993834,3cyclictest810255-21kworker/u8:3+events_unbound12:26:121
519760993830,6cyclictest721151-21kworker/u8:1+events_unbound10:51:171
519760993728,7cyclictest810255-21kworker/u8:3+events_unbound12:06:211
519760993728,6cyclictest825471-21latency_hist12:15:011
519760993726,8cyclictest655642-21latency_hist09:25:011
519758993727,8cyclictest799613-21ntpq11:46:180
519758993727,8cyclictest799613-21ntpq11:46:170
519764993631,3cyclictest775742-21kworker/u8:3+events_unbound11:45:012
519764993631,3cyclictest775742-21kworker/u8:3+events_unbound11:45:002
519764993631,3cyclictest519933-21kworker/u8:1+flush-8:007:25:102
519760993631,3cyclictest796796-21kthreadcore11:46:141
519760993631,3cyclictest796796-21kthreadcore11:46:141
51975899367,16cyclictest614912-21ntpq08:41:180
519758993628,6cyclictest685334-21ntpq09:51:160
519758993628,5cyclictest590892-21latency_hist08:20:000
519758993627,6cyclictest282-21systemd-journal10:03:330
51478123621,9sleep10-21swapper/107:05:231
519760993529,4cyclictest696129-21kworker/u8:2+events_unbound11:06:161
519760993526,7cyclictest282-21systemd-journal09:50:001
519758993527,5cyclictest576087-21latency_hist08:05:010
519758993523,9cyclictest282-21systemd-journal12:26:330
519758993522,10cyclictest527184-21diskstats07:16:060
519764993430,3cyclictest581250-21kworker/u8:0+events_unbound08:26:252
519760993427,5cyclictest731607-21apt-get10:41:051
519760993427,5cyclictest730436-21ntpq10:36:181
519760993426,6cyclictest671663-21kworker/u8:1+flush-8:010:01:081
51975899347,16cyclictest794747-21ntpq11:41:190
51975899347,16cyclictest794747-21ntpq11:41:190
51975899346,16cyclictest707112-21ps10:16:100
519758993424,8cyclictest282-21systemd-journal09:45:000
519760993327,4cyclictest696129-21kworker/u8:2+events_unbound10:31:231
519760993326,5cyclictest581250-21kworker/u8:0+events_unbound09:01:111
519760993325,6cyclictest706025-21apt-get10:15:011
519760993325,6cyclictest519933-21kworker/u8:1+flush-8:008:01:171
519760993325,6cyclictest519933-21kworker/u8:1+flush-8:007:16:191
519760993324,7cyclictest755083-21ntpq11:01:191
51975899337,15cyclictest634976-21python309:01:230
51975899336,17cyclictest670281-21ntpq09:36:170
51975899335,18cyclictest624756-21ntpq08:51:210
51975899335,16cyclictest644710-21ntpq09:11:190
51975899334,17cyclictest550455-21ntpq07:36:170
519758993325,6cyclictest806014-21apt-get11:56:030
519760993225,5cyclictest545519-21ntpq07:31:171
51975899329,7cyclictest848469-21tr12:36:290
51975899328,14cyclictest829622-21ntpq12:16:170
51975899327,15cyclictest620106-21python308:46:240
51975899327,14cyclictest824602-21ntpq12:11:150
51975899327,14cyclictest660054-21ntpq09:26:180
51975899327,13cyclictest560430-21ntpq07:46:160
51975899326,15cyclictest687075-21ps09:56:090
51975899323,8cyclictest804922-21gcc11:51:190
51975899323,20cyclictest581322-21/usr/sbin/munin08:11:260
51975899323,11cyclictest844368-21ntpq12:31:180
519758993228,2cyclictest640535-21systemd-run09:09:590
519758993211,10cyclictest540996-21/usr/sbin/munin07:26:210
519764993126,3cyclictest650255-21unixbench_multi09:16:242
519760993125,4cyclictest3880451-21kworker/u8:3+events_unbound07:56:241
519760993124,6cyclictest696129-21kworker/u8:2+flush-8:011:21:171
519760993124,5cyclictest611070-21apt-get08:41:031
519760993121,8cyclictest282-21systemd-journal12:05:001
51975899319,11cyclictest721434-21munin-node10:31:040
51975899318,9cyclictest716525-21apt-get10:26:040
51975899318,10cyclictest774835-21ntpq11:21:150
51975899317,14cyclictest715316-21ntpq10:21:160
51975899317,12cyclictest649872-21ntpq09:16:200
51975899317,10cyclictest580420-21python308:06:210
51975899316,15cyclictest819775-21ntpq12:06:210
51975899316,14cyclictest745295-21ntpq10:51:200
51975899316,14cyclictest561842-21diskstats07:51:070
51975899316,13cyclictest535686-21ntpq07:21:170
51975899316,12cyclictest779881-21ntpq11:26:330
51975899315,17cyclictest545608-21ntpq07:31:190
51975899315,13cyclictest756515-21df_inode11:06:070
519758993122,7cyclictest740283-21ntpq10:46:170
519764993021,7cyclictest282-21systemd-journal08:57:322
519760993026,2cyclictest748555-21kthreadcore10:56:161
519760993025,3cyclictest810310-21unixbench_singl11:56:231
519760993024,4cyclictest591143-21kworker/u8:2+flush-8:008:31:191
519760993023,4cyclictest581250-21kworker/u8:0+events_unbound08:11:261
519760993021,7cyclictest696129-21kworker/u8:2+flush-8:011:41:191
519760993021,7cyclictest696129-21kworker/u8:2+flush-8:011:41:191
51975899308,9cyclictest789987-21python311:36:230
51975899308,12cyclictest591747-21/usr/sbin/munin08:21:100
51975899307,13cyclictest665408-21python309:31:280
51975899306,14cyclictest811221-21diskstats12:01:090
51975899306,12cyclictest605044-21ntpq08:31:210
51975899306,11cyclictest701639-21df10:11:100
519760992924,3cyclictest0-21swapper/110:25:001
519760992920,7cyclictest789714-21ntpq11:36:171
51975899295,14cyclictest551939-21df07:41:050
51975899293,14cyclictest746649-21df10:56:100
51975899293,14cyclictest523900-21ntpq07:11:190
51975899293,11cyclictest751691-21fschecks_time11:01:090
519758992924,3cyclictest606726-21sort08:36:100
519764992823,3cyclictest720747-21unixbench_multi10:26:242
519764992821,5cyclictest661092-21gpgv09:30:012
519760992822,5cyclictest581250-21kworker/u8:0+events_unbound09:36:171
519760992822,4cyclictest696129-21kworker/u8:2+flush-8:011:51:171
519760992822,4cyclictest519933-21kworker/u8:1+flush-8:008:36:031
51976499277,5cyclictest748768-21seq10:56:162
519764992722,3cyclictest591143-21kworker/u8:2+flush-8:008:35:162
519764992719,6cyclictest282-21systemd-journal11:30:002
519760992722,3cyclictest3880451-21kworker/u8:3+events_unbound07:26:081
519764992622,2cyclictest566761-21tr07:56:072
519764992621,4cyclictest696129-21kworker/u8:2+events_unbound11:53:512
519764992621,4cyclictest519933-21kworker/u8:1+events_unbound08:30:072
519764992620,4cyclictest591143-21kworker/u8:2+events_unbound09:05:022
519764992619,5cyclictest706025-21apt-get10:15:002
519760992621,4cyclictest591143-21kworker/u8:2+flush-8:008:46:201
519760992621,3cyclictest640535-21systemd-run09:10:001
519760992618,6cyclictest830723-21/usr/sbin/munin12:21:131
519760992618,6cyclictest721151-21kworker/u8:1+flush-8:011:16:181
8241672250,2sleep3471rcuc/312:11:123
519764992521,3cyclictest696129-21kworker/u8:2+events_unbound10:45:022
519764992521,2cyclictest591460-21cpuspeed_turbos08:21:052
519764992520,4cyclictest696129-21kworker/u8:2+events_unbound11:22:162
519764992520,3cyclictest531550-21awk07:20:002
519760992521,2cyclictest0-21swapper/112:20:011
519760992516,7cyclictest282-21systemd-journal10:09:331
519764992421,2cyclictest826107-21fschecks_time12:16:072
519764992420,2cyclictest666852-21fschecks_count09:36:092
51976499240,13cyclictest556682-21apt-get07:46:022
519760992420,2cyclictest656790-21irqcore09:26:101
519760992416,6cyclictest553887-21kthreadcore07:41:121
6842192230,6chrt0-21swapper/209:51:132
51976499234,10cyclictest371rcuc/211:01:142
51976499232,10cyclictest161rcu_preempt08:01:042
519764992320,2cyclictest786307-21fschecks_time11:36:092
519764992319,3cyclictest800228-21kworker/u8:1+events_unbound12:02:212
519764992319,3cyclictest581250-21kworker/u8:0+events_unbound09:59:092
519760992317,5cyclictest640754-21kworker/u8:3+flush-8:009:51:071
519760992316,5cyclictest780986-21apt-get11:31:031
5192952239,10sleep20-21swapper/207:08:452
519764992218,3cyclictest721151-21kworker/u8:1+events_unbound11:15:142
519764992218,3cyclictest581250-21kworker/u8:0+events_unbound10:05:022
519764992218,2cyclictest0-21swapper/212:40:002
519764992218,2cyclictest0-21swapper/209:25:012
519764992217,4cyclictest791249-21uniq11:41:092
519764992217,4cyclictest791249-21uniq11:41:082
519764992217,4cyclictest715923-21kworker/u8:0+events_unbound10:32:162
519760992218,2cyclictest763543-21runrttasks11:11:141
519764992115,4cyclictest282-21systemd-journal08:10:012
5191892212,13sleep00-21swapper/007:07:230
51976499204,9cyclictest161rcu_preempt12:21:182
519764992016,3cyclictest706486-21kworker/u8:3+events_unbound10:15:132
519764992016,3cyclictest519933-21kworker/u8:1+events_unbound08:17:162
519764992016,2cyclictest0-21swapper/210:05:012
51976499193,9cyclictest824567-21netstat12:11:132
51976499192,12cyclictest806014-21apt-get11:56:042
51976499191,9cyclictest371rcuc/210:41:162
51976499190,7cyclictest760894-21idleruntime-cro11:10:002
51976499183,8cyclictest0-21swapper/209:46:062
51976499182,6cyclictest0-21swapper/207:11:042
51976499180,9cyclictest8178371kthreadcore12:06:132
51976499180,3cyclictest7297172cut10:36:142
5147582183,9sleep30-21swapper/307:05:053
51976499177,3cyclictest7420571irqcore10:51:112
6259692162,9sleep30-21swapper/308:56:053
5851452164,9sleep30-21swapper/308:11:193
51976499162,2cyclictest0-21swapper/207:36:192
8451892132,7sleep30-21swapper/312:35:013
7727862132,7sleep30-21swapper/311:21:133
7553392132,7sleep30-21swapper/311:01:263
7477662132,6sleep30-21swapper/310:56:163
7319792132,7sleep30-21swapper/310:41:113
6821262132,7sleep30-21swapper/309:51:113
6506272132,6sleep30-21swapper/309:20:013
6256232132,6sleep30-21swapper/308:55:013
6149612132,7sleep30-21swapper/308:41:193
5714552132,7sleep30-21swapper/308:01:033
5414432132,7sleep30-21swapper/307:30:013
8475472122,6sleep30-21swapper/312:36:293
8260332122,6sleep30-21swapper/312:16:063
8112222122,6sleep30-21swapper/312:01:103
8056462122,6sleep30-21swapper/311:54:393
7986182122,6sleep30-21swapper/311:46:173
7986182122,6sleep30-21swapper/311:46:173
7947012122,6sleep30-21swapper/311:41:193
7947012122,6sleep30-21swapper/311:41:193
7760432122,6sleep30-21swapper/311:26:173
7697502122,6sleep30-21swapper/311:16:153
7608862122,6sleep30-21swapper/311:10:003
7368482122,6sleep30-21swapper/310:46:093
7261472122,5sleep30-21swapper/310:35:003
7254672123,5sleep30-21swapper/310:31:243
7115702122,7sleep30-21swapper/310:21:053
7106862122,6sleep30-21swapper/310:16:233
6904822122,6sleep30-21swapper/309:56:213
6723792122,6sleep30-21swapper/309:41:123
6348862122,6sleep30-21swapper/309:01:233
6066582122,6sleep30-21swapper/308:36:113
6048922122,6sleep30-21swapper/308:31:173
5710852122,6sleep30-21swapper/307:59:353
5661862122,5sleep30-21swapper/307:55:003
5205322122,6sleep30-21swapper/307:11:113
8395232112,6sleep30-21swapper/312:26:223
8307522112,5sleep30-21swapper/312:21:043
8158712112,6sleep30-21swapper/312:05:233
8097212112,5sleep30-21swapper/311:56:163
7856522111,6sleep30-21swapper/311:35:013
7812292112,5sleep30-21swapper/311:31:083
7562442112,6sleep30-21swapper/311:06:043
7418802112,5sleep30-21swapper/310:51:113
7013292112,5sleep30-21swapper/310:10:343
7005382112,5sleep30-21swapper/310:06:243
6915352112,5sleep30-21swapper/310:01:063
6766762112,6sleep30-21swapper/309:46:013
6702912112,5sleep30-21swapper/309:36:183
6613582113,5sleep30-21swapper/309:30:573
6509352112,6sleep30-21swapper/309:20:413
6412322112,5sleep30-21swapper/309:11:103
6395562112,5sleep30-21swapper/309:06:173
6203492112,5sleep30-21swapper/308:46:263
5961652112,6sleep30-21swapper/308:25:393
5909312112,5sleep30-21swapper/308:20:013
5862802112,5sleep30-21swapper/308:16:043
5610302112,5sleep30-21swapper/307:47:073
5517082112,6sleep30-21swapper/307:41:053
5467802112,6sleep30-21swapper/307:36:073
5461112112,5sleep30-21swapper/307:31:343
5364142112,5sleep30-21swapper/307:23:473
5268692112,5sleep30-21swapper/307:15:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional