You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-11 - 21:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Tue Aug 11, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
87971995748,5cyclictest154280-21latency_hist10:20:013
87960995524,5cyclictest156073-21idleruntime-cro10:25:011
87960995445,5cyclictest119603-21idleruntime-cro08:39:591
87960995219,8cyclictest169476-21grep11:00:261
87956995040,6cyclictest112154-21unixbench_singl08:15:260
87960994919,5cyclictest0-21swapper/107:10:261
87960994836,8cyclictest181871-21sendmail11:40:001
87956994633,9cyclictest121ktimers/011:00:130
87956994633,5cyclictest147090-21kworker/u8:1+events_unbound10:09:030
87956994532,9cyclictest176273-21grep11:20:240
87960994231,8cyclictest231ktimers/109:45:141
87960994228,11cyclictest231ktimers/112:00:141
87960994228,11cyclictest231ktimers/112:00:141
87965994133,6cyclictest311ktimers/208:05:142
8796599410,9cyclictest0-21swapper/208:00:122
87960994133,4cyclictest0-21swapper/108:20:011
87956994135,4cyclictest162962-21kworker/u8:1+events_unbound10:49:120
87956994135,4cyclictest148863-21kworker/u8:2+events_unbound10:19:080
87956994130,7cyclictest140094-21basename09:40:010
87956994130,5cyclictest131rcu_preempt07:20:240
87971994032,4cyclictest0-21swapper/311:25:013
87956994032,5cyclictest136670-21latency_hist09:30:010
87960993927,9cyclictest231ktimers/111:15:141
87956993932,5cyclictest112250-21kworker/u8:0+events_unbound08:38:410
87956993922,5cyclictest131rcu_preempt07:36:130
87965993832,4cyclictest126051-21kworker/u8:2+events_unbound08:58:442
87965993831,4cyclictest163107-21munin-run10:45:002
87965993831,4cyclictest147305-21cron10:00:002
87965993831,4cyclictest147305-21cron09:59:592
87965993826,7cyclictest0-21swapper/211:10:262
87965993825,9cyclictest148591-21grep10:00:282
87960993830,4cyclictest0-21swapper/110:40:001
87960993830,4cyclictest0-21swapper/110:40:001
87960993827,7cyclictest0-21swapper/108:30:251
87956993831,5cyclictest95201-21kworker/u8:0+events_unbound07:28:340
87956993828,5cyclictest0-21swapper/010:24:070
87956993825,5cyclictest110501-21kworker/u8:1-events_freezable_power_08:11:570
87956993813,18cyclictest131rcu_preempt10:00:170
87965993726,6cyclictest0-21swapper/210:05:142
87960993729,4cyclictest0-21swapper/110:20:011
87956993718,12cyclictest11-21ksoftirqd/011:15:150
87956993718,10cyclictest131rcu_preempt08:24:260
87956993716,10cyclictest131rcu_preempt07:50:120
87956993716,10cyclictest131rcu_preempt07:50:120
87971993625,7cyclictest178867-21cut11:30:163
87965993629,4cyclictest95517-21idleruntime-cro07:30:012
87965993629,4cyclictest138366-21auditctl09:35:012
87965993628,4cyclictest0-21swapper/210:50:172
8795699367,13cyclictest11-21ksoftirqd/012:01:350
8795699367,13cyclictest11-21ksoftirqd/012:01:350
87956993625,4cyclictest131rcu_preempt08:00:210
87956993624,4cyclictest131rcu_preempt12:17:020
87956993624,4cyclictest131rcu_preempt11:48:010
87956993621,5cyclictest131rcu_preempt11:27:020
87956993619,11cyclictest131rcu_preempt10:11:530
87956993618,4cyclictest131rcu_preempt08:31:240
87971993527,4cyclictest0-21swapper/312:10:273
87971993527,4cyclictest0-21swapper/311:40:163
87971993527,4cyclictest0-21swapper/308:45:003
87965993526,6cyclictest0-21swapper/208:20:012
87960993527,4cyclictest0-21swapper/108:55:171
87960993526,4cyclictest0-21swapper/111:25:171
87960993526,4cyclictest0-21swapper/109:10:271
87960993526,4cyclictest0-21swapper/107:30:001
87956993527,4cyclictest0-21swapper/012:14:590
87956993526,7cyclictest121ktimers/010:40:120
87956993521,4cyclictest131rcu_preempt11:56:250
87956993518,4cyclictest173122-21kworker/u8:0-events_freezable_power_11:32:090
87956993515,5cyclictest131rcu_preempt11:05:240
87956993512,13cyclictest131rcu_preempt09:50:220
87971993427,4cyclictest105741-21cron07:59:593
87971993427,4cyclictest105741-21cron07:59:593
87971993424,6cyclictest0-21swapper/307:35:263
87965993426,4cyclictest0-21swapper/211:35:252
87960993426,4cyclictest0-21swapper/109:55:181
87960993426,4cyclictest0-21swapper/109:55:171
87960993425,4cyclictest0-21swapper/109:35:191
87960993424,6cyclictest0-21swapper/107:25:011
87956993422,5cyclictest131rcu_preempt09:25:010
87956993421,8cyclictest121ktimers/012:20:260
87956993421,4cyclictest131rcu_preempt09:31:420
87956993420,6cyclictest131rcu_preempt10:50:510
87956993417,5cyclictest131rcu_preempt09:03:200
87956993415,10cyclictest131rcu_preempt09:05:240
87971993325,4cyclictest0-21swapper/310:50:173
8796599335,5cyclictest131rcu_preempt09:50:132
8796599333,7cyclictest131rcu_preempt07:40:112
8795699339,7cyclictest11-21ksoftirqd/010:25:270
87956993322,4cyclictest131rcu_preempt12:09:250
87956993318,4cyclictest131rcu_preempt12:38:010
87956993315,4cyclictest131rcu_preempt11:52:340
87956993315,10cyclictest131rcu_preempt08:52:090
87956993313,9cyclictest131rcu_preempt07:15:290
87956993311,12cyclictest131rcu_preempt08:40:210
87971993224,4cyclictest0-21swapper/312:00:173
87971993224,4cyclictest0-21swapper/312:00:173
87971993222,6cyclictest0-21swapper/309:15:013
8796599327,5cyclictest131rcu_preempt10:10:122
87965993223,5cyclictest0-21swapper/209:45:272
87965993223,4cyclictest0-21swapper/208:00:002
87965993223,4cyclictest0-21swapper/208:00:002
87965993220,8cyclictest204-21dbus-daemon10:39:102
87965993220,8cyclictest204-21dbus-daemon10:39:092
87960993225,4cyclictest190815-21fschecks_time12:05:181
8795699328,5cyclictest151rcuc/007:58:530
8795699328,5cyclictest151rcuc/007:58:520
87956993225,4cyclictest133252-21munin-plugin-st09:20:010
87956993219,4cyclictest131rcu_preempt11:35:340
87956993215,5cyclictest131rcu_preempt07:47:470
87956993215,10cyclictest131rcu_preempt11:10:230
87956993214,9cyclictest131rcu_preempt08:56:370
87956993214,5cyclictest131rcu_preempt10:56:520
87956993210,12cyclictest11-21ksoftirqd/011:40:190
87971993124,4cyclictest159669-21cron10:35:003
87971993124,4cyclictest159669-21cron10:35:003
87971993123,4cyclictest0-21swapper/309:45:173
87971993123,4cyclictest0-21swapper/307:10:253
8796599313,5cyclictest131rcu_preempt11:20:112
87965993124,4cyclictest129559-21kworker/u8:2+events_unbound09:28:532
87965993124,3cyclictest0-21swapper/208:40:002
87965993123,4cyclictest0-21swapper/207:10:162
87965993121,7cyclictest0-21swapper/209:40:012
87965993121,6cyclictest92090-21sh07:20:012
87960993124,4cyclictest0-21swapper/108:40:251
87960993123,5cyclictest138364-21cron09:35:001
87960993123,4cyclictest0-21swapper/110:30:001
87960993123,4cyclictest0-21swapper/108:10:251
87960993120,7cyclictest0-21swapper/108:25:011
87956993113,7cyclictest131rcu_preempt10:30:220
87956993113,7cyclictest131rcu_preempt10:30:210
87956993113,4cyclictest131rcu_preempt07:40:160
87956993113,11cyclictest131rcu_preempt07:12:060
87956993112,9cyclictest131rcu_preempt09:40:150
87956993112,12cyclictest131rcu_preempt12:30:170
87956993110,5cyclictest131rcu_preempt08:05:250
87971993025,3cyclictest173122-21kworker/u8:0+events_unbound11:14:173
87971993024,4cyclictest129559-21kworker/u8:2+events_unbound09:08:463
87971993024,4cyclictest112250-21kworker/u8:0+events_unbound08:28:403
87971993022,5cyclictest0-21swapper/310:30:013
87971993022,4cyclictest0-21swapper/312:15:253
87971993022,4cyclictest0-21swapper/311:00:263
87965993023,4cyclictest87948-21cyclictest09:20:262
87965993023,3cyclictest0-21swapper/209:05:162
87965993022,6cyclictest185053-21kworker/u8:0+events_unbound11:54:192
87965993021,5cyclictest178894-21grep11:30:162
87960993021,4cyclictest0-21swapper/108:08:351
87956993020,6cyclictest0-21swapper/009:55:270
87956993020,6cyclictest0-21swapper/009:55:270
87956993019,4cyclictest131rcu_preempt09:10:130
87956993018,5cyclictest133008-21kworker/u8:3+events_unbound09:47:520
87956993015,4cyclictest131rcu_preempt08:47:370
87956993015,4cyclictest131rcu_preempt08:47:360
87956993015,4cyclictest131rcu_preempt07:31:340
87956993014,9cyclictest131rcu_preempt12:25:200
87956993013,4cyclictest131rcu_preempt10:40:000
87956993013,4cyclictest131rcu_preempt10:40:000
87971992922,5cyclictest98684-21kworker/u8:0+events_unbound08:03:363
87971992922,3cyclictest0-21swapper/309:20:003
87971992921,5cyclictest119585-21cron08:40:003
87971992921,4cyclictest0-21swapper/311:05:173
87971992921,4cyclictest0-21swapper/308:55:273
87971992920,5cyclictest0-21swapper/309:50:173
87971992920,4cyclictest0-21swapper/311:35:163
87971992918,8cyclictest140089-21tr09:40:013
87965992921,6cyclictest102150-21kworker/u8:2+events_unbound07:48:342
87965992920,4cyclictest0-21swapper/209:20:012
87965992919,6cyclictest0-21swapper/210:30:012
87960992922,4cyclictest0-21swapper/109:40:141
87960992921,4cyclictest0-21swapper/110:05:231
87960992921,4cyclictest0-21swapper/108:45:261
87960992921,4cyclictest0-21swapper/108:45:261
87960992918,7cyclictest1-21systemd12:39:231
87956992912,9cyclictest131rcu_preempt08:25:200
87971992820,4cyclictest0-21swapper/312:35:253
8796599288,3cyclictest131rcu_preempt11:20:012
8796599281,9cyclictest1910332wc12:05:222
87965992818,7cyclictest171634-21cut11:10:002
87960992822,4cyclictest145-21jbd2/mmcblk1p2-811:24:071
87960992821,3cyclictest0-21swapper/111:45:261
87960992821,3cyclictest0-21swapper/110:50:241
87960992820,5cyclictest198924-21munin-plugin-st12:30:011
87971992721,4cyclictest137197-21runrttasks09:30:183
87971992720,4cyclictest197212-21sh12:25:013
87971992719,5cyclictest0-21swapper/308:10:263
87971992718,6cyclictest0-21swapper/312:30:283
87971992718,6cyclictest0-21swapper/312:30:013
87971992718,5cyclictest0-21swapper/312:05:203
8797199271,5cyclictest0-21swapper/308:20:543
87971992714,9cyclictest391ktimers/310:00:143
87965992719,5cyclictest200617-21auditctl12:35:012
87965992718,6cyclictest0-21swapper/210:35:002
87965992718,6cyclictest0-21swapper/210:35:002
87965992717,6cyclictest0-21swapper/211:00:262
87965992715,10cyclictest311ktimers/208:30:112
87960992718,5cyclictest0-21swapper/108:00:001
87960992718,5cyclictest0-21swapper/108:00:001
87971992618,4cyclictest0-21swapper/310:20:243
87971992616,6cyclictest136658-21cron09:30:013
87965992620,4cyclictest180009-21kworker/u8:1+events_unbound12:10:192
87965992616,7cyclictest195710-21sed12:20:012
87960992619,5cyclictest208-21systemd-logind11:30:401
87960992619,4cyclictest127653-21tail09:00:251
87965992518,5cyclictest127784-21kworker/u8:0+events_unbound09:10:212
87965992517,4cyclictest0-21swapper/207:50:272
87965992517,4cyclictest0-21swapper/207:50:272
87965992515,7cyclictest92524-21fschecks_time07:20:152
87965992515,7cyclictest53-21kcompactd008:25:182
87965992515,7cyclictest197204-21cron12:25:012
87960992517,4cyclictest0-21swapper/110:40:161
87960992517,4cyclictest0-21swapper/107:15:211
87960992516,4cyclictest0-21swapper/107:45:281
87971992418,3cyclictest0-21swapper/310:10:233
87971992418,3cyclictest0-21swapper/309:05:003
87971992416,4cyclictest0-21swapper/310:44:113
87971992414,6cyclictest0-21swapper/308:30:253
8796599247,8cyclictest131rcu_preempt08:25:012
8796599244,4cyclictest131rcu_preempt12:25:112
87965992418,4cyclictest95201-21kworker/u8:0+events_unbound07:30:252
87965992416,5cyclictest0-21swapper/211:45:262
87965992416,4cyclictest0-21swapper/210:15:172
87965992415,6cyclictest311ktimers/211:55:152
87965992410,7cyclictest32-21ksoftirqd/211:25:272
87960992416,4cyclictest0-21swapper/109:50:171
87971992317,3cyclictest0-21swapper/308:50:213
87971992316,4cyclictest0-21swapper/311:45:233
8796599239,3cyclictest131rcu_preempt11:40:192
87965992317,4cyclictest200365-21kworker/u8:1+events_unbound12:35:422
87965992315,6cyclictest108766-21kworker/u8:2+events_unbound08:10:412
8796599230,4cyclictest98922-21idleruntime-cro07:40:012
8796599230,3cyclictest127214-21tr09:00:222
87960992316,5cyclictest208-21systemd-logind11:50:401
87960992316,3cyclictest0-21swapper/107:50:271
87960992316,3cyclictest0-21swapper/107:50:261
87960992316,3cyclictest0-21swapper/107:35:251
87960992315,5cyclictest0-21swapper/111:40:251
87960992315,4cyclictest0-21swapper/107:30:211
87960992313,8cyclictest106485-21sed08:00:211
87960992313,6cyclictest231ktimers/110:00:251
87971992217,3cyclictest99832-21/usr/sbin/munin07:40:213
87971992214,5cyclictest160447-21ntpq10:35:213
87971992214,5cyclictest160447-21ntpq10:35:213
87971992214,5cyclictest145-21jbd2/mmcblk1p2-811:25:173
87971992214,5cyclictest0-21swapper/310:50:003
87971992214,5cyclictest0-21swapper/307:50:223
87971992214,5cyclictest0-21swapper/307:50:223
87971992214,4cyclictest134955-21cron09:25:013
87971992213,6cyclictest0-21swapper/311:00:003
87965992216,3cyclictest0-21swapper/208:50:112
87960992216,3cyclictest0-21swapper/112:30:221
87960992216,3cyclictest0-21swapper/109:20:261
87960992216,3cyclictest0-21swapper/109:05:201
87960992215,4cyclictest131932-21fschecks_count09:15:161
87960992214,5cyclictest231ktimers/111:55:181
87960992212,7cyclictest136682-21basename09:30:011
87971992115,3cyclictest0-21swapper/309:40:233
87971992115,3cyclictest0-21swapper/308:45:163
87971992115,3cyclictest0-21swapper/308:45:163
87971992115,3cyclictest0-21swapper/307:20:263
87971992114,4cyclictest112581-21sendmail08:20:013
87971992111,7cyclictest0-21swapper/308:05:243
8796599217,4cyclictest131rcu_preempt10:20:042
87965992115,4cyclictest162962-21kworker/u8:1+events_unbound10:57:572
87965992115,4cyclictest117835-21kworker/u8:1+events_unbound08:40:182
87965992115,3cyclictest645-21runrttasks08:45:162
87965992115,3cyclictest645-21runrttasks08:45:162
87965992114,5cyclictest311ktimers/212:01:582
87965992114,5cyclictest311ktimers/212:01:572
8796099219,9cyclictest152448-21basename10:15:011
8796099219,7cyclictest99347-21fschecks_time07:40:141
87960992115,3cyclictest0-21swapper/112:20:221
87960992115,3cyclictest0-21swapper/112:15:161
87960992115,3cyclictest0-21swapper/110:30:281
87960992115,3cyclictest0-21swapper/110:30:281
87960992115,3cyclictest0-21swapper/108:25:251
87960992113,4cyclictest0-21swapper/108:50:211
8796099211,15cyclictest164791-21cron10:49:591
87971992014,3cyclictest149256-21/usr/sbin/munin10:05:233
87971992014,3cyclictest0-21swapper/311:50:143
87971992013,5cyclictest0-21swapper/307:15:053
87971992011,6cyclictest0-21swapper/307:25:263
87965992013,4cyclictest164800-21idleruntime-cro10:50:002
87960992014,4cyclictest164-21systemd-journal12:12:401
87960992013,5cyclictest231ktimers/111:10:211
87971991913,4cyclictest187545-21irqstats11:55:193
87971991912,4cyclictest96762-21unixbench_singl07:30:263
8797199189,6cyclictest101376-21cat07:45:223
87960991811,3cyclictest0-21swapper/110:55:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional