You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-15 - 22:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sat Nov 15, 2025 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8673682900,3chrt586-21kworker/3:2-events08:16:253
8333622700,1sleep0833366-21tr07:41:260
8593112640,1sleep0859314-21wc08:06:260
9790282600,2sleep3586-21kworker/3:2-events10:06:373
9414452560,2sleep20-21swapper/209:31:242
799139995648,6cyclictest282-21systemd-journal08:40:012
799134995647,6cyclictest1123533-21latency_hist12:35:010
799138995446,6cyclictest1008625-21ntpq10:36:291
799138995347,4cyclictest964436-21kworker/u8:3+events_unbound10:41:351
799138995229,19cyclictest840573-21latency_hist07:50:011
799138995142,7cyclictest1028424-21ntpq10:56:311
799134995145,4cyclictest881094-21kworker/u8:1+flush-8:008:41:340
799138995032,15cyclictest855784-21apt-get08:06:151
799134994941,6cyclictest1029244-21latency_hist11:00:010
799138994739,6cyclictest840889-21/usr/sbin/munin07:51:281
799138994629,14cyclictest990064-21apt-get10:21:171
9086312450,1chrt908635-21kthreadcore08:56:270
799138994536,7cyclictest1059460-21/usr/sbin/munin11:31:331
799138994435,7cyclictest890691-21/usr/sbin/munin08:41:291
799138994427,3cyclictest816390-21tr07:26:181
799138994425,6cyclictest282-21systemd-journal11:56:501
799138994425,3cyclictest1113707-21systemd-run12:25:001
799138994419,7cyclictest1118600-21latency_hist12:30:011
799138994337,4cyclictest944977-21latency_hist09:35:011
799138994333,8cyclictest973826-21ntpq10:01:311
799138994318,6cyclictest0-21swapper/108:16:231
799138994236,4cyclictest964436-21kworker/u8:3+flush-8:010:16:251
799138994233,7cyclictest1068193-21ntpq11:36:361
799134994238,3cyclictest870535-21kworker/u8:3+flush-8:008:21:500
799134994235,5cyclictest881094-21kworker/u8:1+flush-8:009:16:210
799134994234,6cyclictest935467-21apt-get09:26:150
799138994133,6cyclictest1018529-21ntpq10:46:291
799138994117,8cyclictest282-21systemd-journal07:16:171
799138994023,4cyclictest1128125-21unixbench_multi12:36:391
799138994023,3cyclictest1100157-21kthreadcore12:11:251
799134994034,5cyclictest4162997-21kworker/u8:3+flush-8:007:21:350
799134994032,6cyclictest1044289-21latency_hist11:15:010
799134994031,7cyclictest998742-21ntpq10:26:310
799134994031,7cyclictest904322-21ntpq08:51:270
799134993933,4cyclictest870535-21kworker/u8:3+flush-8:008:46:220
799138993833,3cyclictest1098682-21gpgv12:10:001
799138993833,3cyclictest1098682-21gpgv12:10:001
799138993826,9cyclictest949056-21ntpq09:36:271
799134993831,5cyclictest849569-21ntpq07:56:280
799134993829,6cyclictest1113686-21latency_hist12:25:010
8451092370,2sleep2381ktimers/207:51:362
799138993728,6cyclictest799383-21apt-get07:11:141
799138993727,8cyclictest1033570-21ntpq11:01:321
799134993733,3cyclictest1014663-21kworker/u8:0+flush-8:011:56:210
8746472360,2sleep3481ktimers/308:22:153
799138993632,3cyclictest1014663-21kworker/u8:0+flush-8:011:16:211
799138993626,7cyclictest282-21systemd-journal11:44:491
799134993630,4cyclictest934783-21grep09:21:370
799134993629,5cyclictest1014663-21kworker/u8:0+events_unbound12:06:300
799134993629,5cyclictest1014663-21kworker/u8:0+events_unbound12:06:300
799134993528,5cyclictest1078651-21kworker/u8:1+events_unbound12:36:360
799134993527,5cyclictest4162997-21kworker/u8:3+flush-8:007:26:290
799134993524,8cyclictest282-21systemd-journal08:35:010
799138993428,4cyclictest826280-21journal-offline07:36:201
799134993430,3cyclictest825655-21kworker/u8:0+flush-8:008:36:200
799134993428,4cyclictest881094-21kworker/u8:1+flush-8:009:31:360
799134993427,5cyclictest964692-21cron09:55:000
799134993427,5cyclictest881094-21kworker/u8:1+flush-8:009:46:300
799138993328,3cyclictest815825-21sh07:25:001
799138993325,5cyclictest969690-21latency_hist10:00:011
799138993324,7cyclictest282-21systemd-journal11:10:001
799134993328,4cyclictest825655-21kworker/u8:0+flush-8:009:11:190
799134993327,5cyclictest1078651-21kworker/u8:1+flush-8:012:15:000
799134993326,5cyclictest949550-21grep09:36:350
799134993228,3cyclictest4162997-21kworker/u8:3+flush-8:007:31:360
799134993227,4cyclictest881094-21kworker/u8:1+flush-8:009:41:340
799134993227,3cyclictest1014663-21kworker/u8:0+events_unbound11:16:350
799134993226,4cyclictest999836-21kworker/u8:2+events_unbound10:36:200
799134993226,4cyclictest969732-21kworker/u8:1+events_unbound11:21:340
799134993225,5cyclictest915548-21base6409:05:040
799139993121,7cyclictest1099054-21cat12:10:012
799139993121,7cyclictest1099054-21cat12:10:012
799138993128,2cyclictest895901-21tr08:46:201
799138993127,3cyclictest1083898-21systemd-run11:55:001
799134993126,3cyclictest999836-21kworker/u8:2+events_unbound11:36:430
799134993126,3cyclictest1023999-21unixbench_singl10:51:380
799139993023,5cyclictest282-21systemd-journal08:11:382
799139993023,5cyclictest282-21systemd-journal08:11:382
799138993022,6cyclictest1003731-21ntpq10:31:301
799139992921,6cyclictest282-21systemd-journal11:30:002
799138992925,2cyclictest935688-21tr09:26:211
799138992924,4cyclictest875262-21systemctl08:25:011
799138992923,4cyclictest821107-21apt-get07:31:161
799134992925,3cyclictest747338-21kworker/u8:0+events_unbound07:15:050
799134992924,4cyclictest881094-21kworker/u8:1+flush-8:009:01:360
799134992924,3cyclictest969732-21kworker/u8:1+flush-8:010:46:360
799134992923,4cyclictest1014663-21kworker/u8:0+events_unbound11:06:220
799139992824,2cyclictest820416-21unixbench_multi07:26:362
799138992823,3cyclictest954514-21unixbench_multi09:41:391
799138992822,4cyclictest854697-21ntpq08:01:321
799138992820,6cyclictest1089173-21apt-get12:01:161
799138992820,6cyclictest1089173-21apt-get12:01:161
799134992823,3cyclictest1010571-21irqrtprio10:41:260
799134992822,4cyclictest964436-21kworker/u8:3+events_unbound10:31:290
799134992822,4cyclictest944704-21kworker/u8:2+events_unbound09:56:190
799134992822,4cyclictest850478-21kworker/u8:2+events_unbound08:11:310
799134992822,4cyclictest850478-21kworker/u8:2+events_unbound08:11:310
799134992822,3cyclictest984733-21cat10:15:010
799139992722,3cyclictest1050656-21kthreadcore11:21:232
799138992722,3cyclictest1020463-21irqrtprio10:51:241
799138992718,7cyclictest825655-21kworker/u8:0+flush-8:009:16:471
79913499274,18cyclictest840609-21kworker/0:1+events08:00:180
799134992722,4cyclictest825655-21kworker/u8:0+flush-8:008:26:320
799134992721,4cyclictest969732-21kworker/u8:1+events_unbound11:01:380
799134992717,8cyclictest839704-21ntpq07:46:290
7944512276,14sleep10-21swapper/107:06:171
799139992621,4cyclictest0-21swapper/210:15:002
79913899267,6cyclictest0-21swapper/108:31:261
799138992621,2cyclictest0-21swapper/109:06:301
799134992622,3cyclictest1063899-21kworker/u8:3+events_unbound12:26:170
799134992622,3cyclictest1014663-21kworker/u8:0+flush-8:012:18:540
799134992621,4cyclictest964436-21kworker/u8:3+flush-8:010:06:250
799134992621,3cyclictest826106-21aten2_r5power_p07:36:180
799134992621,3cyclictest1089401-21cpuspeed_turbos12:01:190
799134992621,3cyclictest1089401-21cpuspeed_turbos12:01:190
799134992620,4cyclictest1063899-21kworker/u8:3+events_unbound11:55:000
799139992522,2cyclictest949023-21needreboot09:36:272
799139992521,3cyclictest831245-21cpuspeed_turbos07:41:202
799139992520,3cyclictest920728-21aten2_r5power_p09:11:172
799139992520,3cyclictest1038425-21tail11:06:272
799138992521,2cyclictest0-21swapper/110:30:001
799138992520,3cyclictest861436-21irqrtprio08:11:231
799138992520,3cyclictest861436-21irqrtprio08:11:231
799138992519,4cyclictest905772-21cpuspeed_turbos08:56:191
799138992516,7cyclictest850430-21cron07:59:591
799138992516,6cyclictest282-21systemd-journal10:06:501
799134992518,5cyclictest999836-21kworker/u8:2+events_unbound11:31:290
799134992518,5cyclictest964436-21kworker/u8:3+events_unbound10:21:370
799134992518,5cyclictest865737-21basename08:16:180
799139992421,2cyclictest870751-21aten2_r5power_v08:21:242
799139992420,2cyclictest985189-21aten2_r5power_p10:16:182
799139992420,2cyclictest0-21swapper/207:15:002
799139992419,3cyclictest1100161-21kthreadcore12:11:252
79913899247,9cyclictest0-21swapper/107:44:381
799138992420,3cyclictest955734-21irqcore09:46:231
799138992420,2cyclictest0-21swapper/112:31:361
799138992416,6cyclictest1104148-21apt-get12:16:161
79913499245,18cyclictest799004-21kworker/0:2+events07:11:100
79913499242,21cyclictest875361-21kworker/0:0+events10:03:380
799134992418,4cyclictest1063899-21kworker/u8:3+flush-8:011:41:280
799134992418,4cyclictest1014663-21kworker/u8:0+flush-8:011:26:330
79913499241,22cyclictest875361-21kworker/0:0+events10:16:290
8004202230,2sleep3586-21kworker/3:2+events07:11:243
79913999233,10cyclictest815043-21ntpq07:21:362
799139992320,2cyclictest855842-21aten2_r5power_e08:06:182
799139992319,2cyclictest1044855-21cpuspeed_turbos11:16:192
79913899236,9cyclictest0-21swapper/110:11:501
79913899236,5cyclictest0-21swapper/109:00:031
799138992319,2cyclictest0-21swapper/111:50:001
799138992319,2cyclictest0-21swapper/109:11:341
799134992319,2cyclictest825655-21kworker/u8:0+events_unbound07:51:200
799139992219,2cyclictest954850-21cron09:45:002
799139992217,3cyclictest0-21swapper/210:40:002
799139992212,8cyclictest1078572-21awk11:46:362
799138992219,2cyclictest799128-21cyclictest09:21:241
799138992218,2cyclictest887899-21kthreadcore08:36:251
799138992218,2cyclictest0-21swapper/108:51:321
799138992214,6cyclictest964691-21cron09:55:001
79913499220,21cyclictest875361-21kworker/0:0+events11:46:220
8478592210,8sleep2371rcuc/207:56:252
799139992117,3cyclictest970268-21cpuspeed_turbos10:01:212
799139992117,3cyclictest1039758-21aten2_r5power_e11:11:182
799139992116,4cyclictest934797-21unixbench_singl09:21:372
799139992113,6cyclictest899582-21grep08:46:342
799138992117,3cyclictest0-21swapper/111:21:171
799138992116,4cyclictest1039939-21sh11:11:201
799138992115,4cyclictest0-21swapper/111:26:361
799138992114,5cyclictest0-21swapper/108:26:211
799139992017,2cyclictest1084445-21cpuspeed_turbos11:56:212
799139992016,2cyclictest0-21swapper/211:01:372
799139992016,2cyclictest0-21swapper/210:45:002
799139992013,5cyclictest282-21systemd-journal10:25:002
799139992013,5cyclictest282-21systemd-journal08:19:492
799139992011,7cyclictest282-21systemd-journal12:24:502
7987782206,10sleep20-21swapper/207:07:382
799139991915,2cyclictest1118235-21unixbench_multi12:26:352
799139991915,2cyclictest0-21swapper/212:36:202
799139991915,2cyclictest0-21swapper/210:10:012
799139991915,2cyclictest0-21swapper/209:06:202
799139991915,2cyclictest0-21swapper/208:01:342
799139991914,4cyclictest825655-21kworker/u8:0+flush-8:008:31:342
799139991912,5cyclictest282-21systemd-journal09:55:002
79913999191,16cyclictest1106152-21cut12:16:252
799139991911,6cyclictest1029643-21sed11:00:012
7972272192,9sleep30-21swapper/307:06:273
7944142192,12sleep00-21swapper/007:06:120
79913999182,12cyclictest955203-21apt-get09:46:172
799139991815,2cyclictest965398-21fschecks_time09:56:212
799139991814,3cyclictest836247-21fschecks_count07:46:202
799139991814,2cyclictest0-21swapper/211:31:422
799139991814,2cyclictest0-21swapper/210:46:342
799139991814,2cyclictest0-21swapper/209:20:012
799139991814,2cyclictest0-21swapper/208:56:242
799139991814,2cyclictest0-21swapper/208:26:212
799139991814,2cyclictest0-21swapper/207:31:192
799139991813,3cyclictest0-21swapper/211:36:352
79913999181,13cyclictest1019735-21apt-get10:51:182
799139991714,2cyclictest826285-21fschecks_count07:36:202
799139991713,2cyclictest1079377-21aten2_r5power_v11:51:212
9050572162,2sleep20-21swapper/208:53:252
79913999167,7cyclictest808435-21tr07:16:242
79913999167,7cyclictest1119703-21sed12:31:252
79913999162,1cyclictest0-21swapper/212:01:292
79913999162,1cyclictest0-21swapper/212:01:282
79913999161,3cyclictest8916392grep08:41:252
799139991613,2cyclictest0-21swapper/210:27:512
799139991612,2cyclictest0-21swapper/210:31:232
79913999160,14cyclictest914466-21taskset09:01:342
79913999156,7cyclictest936935-21tr09:26:262
79913999149,3cyclictest0-21swapper/211:41:242
9150912132,6sleep30-21swapper/309:05:013
8945762132,7sleep30-21swapper/308:41:343
8463262133,7sleep30-21swapper/307:56:233
8150152132,7sleep30-21swapper/307:21:363
11276732132,7sleep30-21swapper/312:36:343
11194092132,7sleep30-21swapper/312:31:253
11087852132,6sleep30-21swapper/312:20:013
10492932132,6sleep30-21swapper/311:20:013
10283652132,7sleep30-21swapper/310:56:303
10094662132,7sleep30-21swapper/310:40:003
9999362122,6sleep30-21swapper/310:31:183
9995732122,5sleep30-21swapper/310:30:013
9859882123,6sleep30-21swapper/310:16:253
9798872122,6sleep30-21swapper/310:11:153
9650522122,6sleep30-21swapper/309:56:183
9643612122,6sleep30-21swapper/309:51:363
9591692122,6sleep30-21swapper/309:46:353
9424582122,6sleep30-21swapper/309:31:263
9355052122,6sleep30-21swapper/309:26:203
9304752122,6sleep30-21swapper/309:20:513
9055432122,6sleep30-21swapper/308:56:193
9010002122,6sleep30-21swapper/308:51:213
8956782123,6sleep30-21swapper/308:46:183
8811802123,6sleep30-21swapper/308:31:233
8758022122,6sleep30-21swapper/308:26:173
8551032122,6sleep30-21swapper/308:01:363
8412602122,6sleep30-21swapper/307:51:223
8210472122,6sleep30-21swapper/307:30:513
8165522122,6sleep30-21swapper/307:26:213
11139662122,6sleep30-21swapper/312:25:513
11034182122,6sleep30-21swapper/312:11:383
10979912122,6sleep30-21swapper/312:06:333
10979912122,6sleep30-21swapper/312:06:333
10838892122,6sleep30-21swapper/311:55:013
10758902122,6sleep30-21swapper/311:46:263
10680332122,6sleep30-21swapper/311:36:353
10545782122,6sleep30-21swapper/311:26:193
10483082122,6sleep30-21swapper/311:16:283
10359982122,6sleep30-21swapper/311:06:253
10338522122,6sleep30-21swapper/311:01:393
10168252122,6sleep30-21swapper/310:46:263
10102702122,6sleep30-21swapper/310:41:253
9944442112,5sleep30-21swapper/310:22:113
9699342112,6sleep30-21swapper/310:00:073
9502052112,6sleep30-21swapper/309:40:293
9452172113,5sleep30-21swapper/309:35:193
9264072112,5sleep30-21swapper/309:16:413
9206172112,6sleep30-21swapper/309:11:163
9104652112,5sleep30-21swapper/309:01:163
8865982112,5sleep30-21swapper/308:36:243
8609662112,5sleep30-21swapper/308:11:203
8609662112,5sleep30-21swapper/308:11:203
8557242112,5sleep30-21swapper/308:05:503
8399922112,5sleep30-21swapper/307:46:363
8354022112,6sleep30-21swapper/307:42:073
8259742113,5sleep30-21swapper/307:36:013
8062222112,5sleep30-21swapper/307:15:503
11040482112,6sleep30-21swapper/312:15:193
10890922112,6sleep30-21swapper/312:00:353
10890922112,6sleep30-21swapper/312:00:353
10791422112,5sleep30-21swapper/311:50:033
10736882112,5sleep30-21swapper/311:41:363
10594852112,5sleep30-21swapper/311:31:203
10415582112,6sleep30-21swapper/311:11:273
10236322112,5sleep30-21swapper/310:51:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional