You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-24 - 00:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sun Aug 23, 2026 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2654439995846,6cyclictest2732072-21kworker/u8:0+events_unbound11:15:092
2654443995444,6cyclictest2728743-21sh10:45:013
265444399531,33cyclictest2757480-21ntp_states12:05:233
2654436995245,5cyclictest2766748-21kworker/u8:1+events_unbound12:35:201
2654432995245,5cyclictest2687205-21kworker/u8:3+events_unbound09:09:380
2654443995141,6cyclictest2768618-21sendmail12:40:003
2654443995128,18cyclictest0-21swapper/309:20:243
2654443995040,6cyclictest2703157-21munin-plugin-st09:30:013
2654443995028,17cyclictest2742119-21grep11:20:253
2654443994919,27cyclictest2669694-21sort07:50:253
2654436994942,4cyclictest2723630-21munin-plugin-st10:30:011
2654432994940,5cyclictest2672021-21run-parts08:00:010
2654443994819,23cyclictest0-21swapper/309:30:163
2654432994842,4cyclictest2718103-21kworker/u8:2+events_unbound10:14:530
265444399461,2cyclictest0-21swapper/309:45:123
2654432994632,10cyclictest121ktimers/011:30:110
2654443994534,5cyclictest2721932-21idleruntime-cro10:25:013
265444399451,11cyclictest2673966-21apt-get08:05:133
265444399441,38cyclictest2753760-21/usr/sbin/munin11:55:163
2654443994413,29cyclictest2752089-21if_eth111:50:173
2654443994412,28cyclictest2744535-21/usr/sbin/munin11:30:223
2654432994438,4cyclictest2730310-21kworker/u8:2+events_unbound10:50:000
265444399432,35cyclictest2728975-21apt-get10:45:113
265444399432,35cyclictest2706802-21apt-get09:40:123
2654443994319,19cyclictest0-21swapper/308:55:263
265444399431,37cyclictest2725789-21/usr/sbin/munin10:35:173
265444399431,37cyclictest2722260-21df10:25:153
2654432994337,4cyclictest2706389-21kworker/u8:1+events_unbound09:44:450
2654432994316,5cyclictest131rcu_preempt10:40:010
265444399422,35cyclictest2681120-21/usr/sbin/munin08:25:153
265444399421,38cyclictest2693709-21/usr/sbin/munin09:00:243
2654436994232,7cyclictest2708718-21fschecks_time09:45:171
2654436994232,6cyclictest0-21swapper/110:50:161
2654436994231,7cyclictest0-21swapper/109:00:001
2654432994236,4cyclictest2672249-21kworker/u8:0+events_unbound08:04:260
2654432994236,4cyclictest2672249-21kworker/u8:0+events_unbound08:04:250
2654432994222,12cyclictest131rcu_preempt09:50:220
2654432994222,12cyclictest131rcu_preempt09:50:220
2654432994220,10cyclictest131rcu_preempt08:59:350
265444399413,34cyclictest2687373-21apt-get08:45:033
2654443994128,10cyclictest391ktimers/312:20:113
265444399411,37cyclictest2750810-21/usr/sbin/munin11:45:263
265444399411,37cyclictest2666511-21/usr/sbin/munin07:40:253
265444399411,35cyclictest2705712-21/usr/sbin/munin09:35:233
265444399411,35cyclictest2663818-21cstates07:35:133
265443299419,21cyclictest131rcu_preempt08:30:000
2654432994135,4cyclictest2683810-21kworker/u8:1+events_unbound08:39:330
265444399403,34cyclictest2662359-21irqstats07:30:203
265444399401,4cyclictest0-21swapper/311:00:123
265444399401,36cyclictest2759140-21/usr/sbin/munin12:10:203
265444399401,36cyclictest2695314-21/usr/sbin/munin09:05:243
265444399401,36cyclictest2670804-21/usr/sbin/munin07:55:183
265444399401,36cyclictest2660911-21/usr/sbin/munin07:25:223
265444399401,36cyclictest2658780-21/usr/sbin/munin07:20:183
265444399401,34cyclictest2675773-21/usr/sbin/munin08:10:153
265444399401,34cyclictest2672470-21/usr/sbin/munin08:00:173
265444399401,34cyclictest2672470-21/usr/sbin/munin08:00:163
265444399400,2cyclictest0-21swapper/307:45:143
2654439994033,4cyclictest2692680-21cron09:00:002
265444399393,25cyclictest2724417-21ntp_states10:30:213
265444399392,32cyclictest2697333-21tail09:10:263
2654443993918,18cyclictest2656729-21sort07:15:053
265444399391,35cyclictest2743560-21/usr/sbin/munin11:25:243
265444399391,35cyclictest2712016-21df_inode09:55:153
265444399391,35cyclictest2712016-21df_inode09:55:153
265444399391,35cyclictest2684277-21cstates08:35:143
265444399391,33cyclictest2732468-21/usr/sbin/munin10:55:143
265444399391,33cyclictest2679086-21apt-get08:20:143
265444399391,32cyclictest2763887-21fschecks_count12:25:163
265444399391,32cyclictest2763887-21fschecks_count12:25:153
265444399391,32cyclictest2677364-21apt-get08:15:143
265444399391,2cyclictest0-21swapper/308:40:123
265444399390,4cyclictest0-21swapper/310:05:113
265444399390,3cyclictest0-21swapper/311:40:143
2654439993929,6cyclictest0-21swapper/211:40:002
2654436993932,4cyclictest2737268-21munin-plugin-st11:10:001
2654436993929,6cyclictest0-21swapper/110:35:261
2654432993925,4cyclictest131rcu_preempt11:28:250
2654432993924,4cyclictest131rcu_preempt11:55:400
2654432993919,10cyclictest131rcu_preempt09:10:030
265444399381,34cyclictest2760302-21/usr/sbin/munin12:15:123
265444399381,34cyclictest2746566-21/usr/sbin/munin11:35:153
265444399381,34cyclictest2698819-21/usr/sbin/munin09:15:273
265444399381,33cyclictest2730437-21cron10:50:013
265444399381,32cyclictest2735776-21sshd11:05:023
265444399381,32cyclictest2717020-21munin-node10:10:113
265444399381,32cyclictest2654779-21fschecks_time07:10:153
2654443993811,24cyclictest2739200-21/usr/sbin/munin11:15:233
2654439993829,6cyclictest2715082-21cron10:05:002
2654432993819,6cyclictest131rcu_preempt07:35:230
2654432993817,12cyclictest131rcu_preempt09:30:240
265444399372,32cyclictest2765427-21apt-get12:30:143
265444399372,32cyclictest2765427-21apt-get12:30:143
265444399371,5cyclictest0-21swapper/308:50:113
265444399371,5cyclictest0-21swapper/308:50:113
265444399371,3cyclictest2713621-21apt-get10:00:123
265444399371,33cyclictest2737946-21meminfo11:10:203
265444399371,33cyclictest2710312-21df_inode09:50:143
265444399371,33cyclictest2710312-21df_inode09:50:143
265444399371,31cyclictest2755199-21apt-get12:00:133
265444399370,2cyclictest0-21swapper/310:15:133
2654439993728,6cyclictest2682627-21fschecks_count08:30:172
2654432993724,9cyclictest2666921-21cut07:45:010
2654432993721,5cyclictest131rcu_preempt07:48:570
2654432993717,11cyclictest131rcu_preempt08:10:250
2654432993716,11cyclictest131rcu_preempt12:18:310
2654432993713,14cyclictest11-21ksoftirqd/010:35:000
2654439993629,4cyclictest2735558-21cron11:05:002
2654439993629,4cyclictest0-21swapper/207:35:012
2654439993626,6cyclictest0-21swapper/212:00:002
2654436993626,7cyclictest231ktimers/112:05:131
2654436993625,7cyclictest2764795-21grep12:25:251
2654436993625,7cyclictest2764795-21grep12:25:251
265443299366,22cyclictest11-21ksoftirqd/007:50:230
2654432993627,5cyclictest121ktimers/009:00:130
2654432993626,6cyclictest0-21swapper/012:25:000
2654432993618,5cyclictest131rcu_preempt08:53:100
2654432993618,5cyclictest131rcu_preempt08:53:090
2654432993615,10cyclictest131rcu_preempt08:07:200
2654436993528,4cyclictest0-21swapper/110:00:151
2654436993526,7cyclictest2721825-21kworker/u8:0+events_unbound10:24:551
2654436993524,6cyclictest0-21swapper/110:10:251
2654432993523,7cyclictest0-21swapper/011:10:260
2654432993522,5cyclictest131rcu_preempt08:15:230
2654432993519,9cyclictest131rcu_preempt10:19:560
2654432993517,10cyclictest131rcu_preempt11:44:120
2654432993515,11cyclictest131rcu_preempt07:20:180
2654432993515,11cyclictest131rcu_preempt07:10:020
2654432993514,10cyclictest131rcu_preempt08:34:520
2654432993513,10cyclictest131rcu_preempt09:20:370
2654439993423,6cyclictest0-21swapper/210:35:262
2654436993428,4cyclictest2730310-21kworker/u8:2+events_unbound11:00:031
2654436993426,4cyclictest0-21swapper/109:35:011
2654436993423,6cyclictest0-21swapper/110:15:261
2654432993428,4cyclictest2723383-21kworker/u8:3+events_unbound10:29:570
2654432993417,5cyclictest131rcu_preempt11:05:240
2654432993417,10cyclictest131rcu_preempt09:26:070
2654432993416,5cyclictest131rcu_preempt10:00:220
2654432993415,5cyclictest131rcu_preempt12:10:150
2654432993415,5cyclictest131rcu_preempt10:40:410
2654432993415,5cyclictest131rcu_preempt07:30:150
2654439993324,5cyclictest0-21swapper/210:20:012
2654436993323,6cyclictest0-21swapper/111:00:001
2654436993318,6cyclictest2687205-21kworker/u8:3+events_unbound09:10:201
2654432993327,4cyclictest2687205-21kworker/u8:3+events_unbound08:49:340
2654432993322,9cyclictest2766748-21kworker/u8:1+events_unbound12:38:410
2654432993318,4cyclictest131rcu_preempt12:30:230
2654432993318,4cyclictest131rcu_preempt12:30:230
2654432993315,4cyclictest131rcu_preempt10:05:230
2654432993314,4cyclictest131rcu_preempt12:07:340
2654432993313,9cyclictest131rcu_preempt11:37:250
2654432993313,9cyclictest131rcu_preempt10:58:520
2654432993313,5cyclictest131rcu_preempt10:50:270
2654432993311,5cyclictest131rcu_preempt11:45:120
2654439993226,4cyclictest2678624-21kworker/u8:1+events_unbound08:19:272
2654439993222,6cyclictest0-21swapper/212:34:592
2654439993222,6cyclictest0-21swapper/212:34:592
2654439993220,9cyclictest311ktimers/210:45:122
2654436993225,4cyclictest0-21swapper/111:35:251
2654436993225,4cyclictest0-21swapper/109:50:261
2654436993225,4cyclictest0-21swapper/109:50:261
2654436993223,6cyclictest0-21swapper/108:05:181
2654436993223,6cyclictest0-21swapper/107:20:281
2654436993222,6cyclictest0-21swapper/109:35:161
2654436993222,6cyclictest0-21swapper/109:25:021
2654436993215,6cyclictest131rcu_preempt11:20:111
2654436993214,4cyclictest2652404-21kworker/u8:2+events_unbound07:10:451
2654432993224,4cyclictest0-21swapper/012:00:140
2654432993219,5cyclictest131rcu_preempt10:25:010
2654432993219,4cyclictest131rcu_preempt07:25:550
2654432993215,5cyclictest131rcu_preempt07:10:150
2654432993215,4cyclictest131rcu_preempt11:53:480
2654432993215,4cyclictest131rcu_preempt07:19:400
2654432993213,5cyclictest131rcu_preempt11:15:160
2654439993122,5cyclictest0-21swapper/211:25:252
2654439993121,6cyclictest0-21swapper/212:15:262
2654439993121,6cyclictest0-21swapper/209:45:272
265443699318,6cyclictest2680114-21unixbench_singl08:20:261
2654436993124,4cyclictest0-21swapper/108:45:261
2654436993122,6cyclictest0-21swapper/111:30:001
2654436993122,5cyclictest0-21swapper/112:35:001
2654436993122,5cyclictest0-21swapper/112:35:001
2654436993121,6cyclictest0-21swapper/107:50:251
2654436993120,7cyclictest0-21swapper/111:55:241
2654432993123,4cyclictest0-21swapper/011:20:250
2654432993119,5cyclictest131rcu_preempt09:36:170
2654432993112,9cyclictest131rcu_preempt12:29:190
2654432993112,9cyclictest131rcu_preempt12:29:180
2654432993112,5cyclictest131rcu_preempt11:03:330
2654439993021,6cyclictest0-21swapper/207:45:262
2654439993020,6cyclictest0-21swapper/208:25:242
2654439993020,6cyclictest0-21swapper/207:15:262
2654439993019,7cyclictest2712908-21grep09:55:262
2654439993019,7cyclictest2712908-21grep09:55:262
265443699309,13cyclictest0-21swapper/110:40:241
265443699308,11cyclictest2724847-21tail10:30:261
265443699305,13cyclictest2673278-21grep08:00:261
265443699305,13cyclictest2673278-21grep08:00:261
2654436993023,5cyclictest2753113-21kworker/u8:2+events_unbound11:53:501
2654436993023,4cyclictest0-21swapper/111:15:281
2654436993022,5cyclictest2670276-21kworker/u8:2+events_unbound08:36:421
2654436993021,6cyclictest0-21swapper/109:55:251
2654436993021,6cyclictest0-21swapper/109:55:251
2654436993021,5cyclictest0-21swapper/111:45:001
2654436993020,7cyclictest0-21swapper/112:15:251
265443699301,3cyclictest131rcu_preempt08:40:121
2654432993018,4cyclictest131rcu_preempt09:58:250
2654432993018,4cyclictest131rcu_preempt09:58:250
2654432993014,4cyclictest131rcu_preempt08:20:390
2654432993012,5cyclictest131rcu_preempt08:40:170
2654439992922,5cyclictest2695759-21kworker/u8:1+events_unbound09:09:522
2654439992922,5cyclictest2652404-21kworker/u8:2+events_unbound07:12:412
2654439992921,4cyclictest0-21swapper/211:10:052
2654439992919,6cyclictest0-21swapper/210:40:252
2654439992919,6cyclictest0-21swapper/208:00:262
2654439992919,6cyclictest0-21swapper/208:00:262
2654439992917,8cyclictest311ktimers/212:00:132
265443999291,5cyclictest0-21swapper/209:30:112
265443999290,5cyclictest2663722-21apt-get07:35:132
265443699292,4cyclictest0-21swapper/108:30:141
2654436992920,5cyclictest0-21swapper/107:25:241
2654432992911,11cyclictest131rcu_preempt09:45:170
2654432992911,11cyclictest131rcu_preempt09:15:250
2654439992821,3cyclictest0-21swapper/212:35:242
2654439992820,5cyclictest2699227-21kworker/u8:1+events_unbound09:17:542
2654439992818,6cyclictest0-21swapper/208:35:252
265443999280,5cyclictest0-21swapper/208:40:132
2654436992821,5cyclictest2715316-21kworker/u8:1+events_unbound10:06:521
2654436992821,4cyclictest0-21swapper/112:10:161
2654436992821,3cyclictest0-21swapper/109:05:171
2654436992820,5cyclictest0-21swapper/110:45:251
2654436992815,6cyclictest2751251-21kworker/u8:0+events_unbound11:47:411
2654436992810,9cyclictest131rcu_preempt07:45:181
2654436992810,10cyclictest131rcu_preempt09:45:011
265443999276,5cyclictest0-21swapper/209:20:242
2654439992722,3cyclictest2687205-21kworker/u8:3+events_unbound09:13:422
2654439992720,3cyclictest0-21swapper/208:10:182
2654439992718,6cyclictest0-21swapper/209:40:252
2654439992718,5cyclictest0-21swapper/209:55:002
2654439992718,5cyclictest0-21swapper/209:54:592
2654439992718,5cyclictest0-21swapper/208:25:012
2654439992711,8cyclictest131rcu_preempt09:35:262
265443699277,13cyclictest24-21ksoftirqd/109:29:171
2654436992721,4cyclictest2658297-21kworker/u8:0+events_unbound07:42:431
2654436992720,4cyclictest0-21swapper/107:20:011
2654436992720,3cyclictest0-21swapper/108:25:241
2654436992713,7cyclictest24-21ksoftirqd/112:20:151
2654439992620,4cyclictest2740481-21kworker/u8:2+events_unbound11:30:102
2654439992619,5cyclictest2718103-21kworker/u8:2+events_unbound10:21:422
2654439992618,5cyclictest2761399-21kworker/u8:1+events_unbound12:25:432
2654439992618,5cyclictest2761399-21kworker/u8:1+events_unbound12:25:432
2654439992618,4cyclictest0-21swapper/211:20:252
2654439992617,6cyclictest145-21jbd2/mmcblk1p2-812:05:172
265443999261,6cyclictest2751098-21sed11:45:282
2654439992616,6cyclictest0-21swapper/212:25:002
265443699266,3cyclictest131rcu_preempt11:35:001
265443699266,13cyclictest24-21ksoftirqd/112:04:521
265443699266,13cyclictest24-21ksoftirqd/107:31:491
265443699264,4cyclictest131rcu_preempt09:00:121
265443999259,3cyclictest131rcu_preempt10:10:222
2654439992519,4cyclictest2730310-21kworker/u8:2+events_unbound10:50:142
2654439992519,4cyclictest2715316-21kworker/u8:1+events_unbound10:09:252
2654439992519,4cyclictest2687205-21kworker/u8:3+events_unbound08:47:202
2654439992518,5cyclictest2670276-21kworker/u8:2+events_unbound08:09:382
2654439992518,4cyclictest0-21swapper/212:10:242
2654439992518,4cyclictest0-21swapper/211:05:262
265443699256,12cyclictest24-21ksoftirqd/107:55:241
2654436992511,6cyclictest2687205-21kworker/u8:3+events_unbound08:50:131
2654436992511,6cyclictest2687205-21kworker/u8:3+events_unbound08:50:131
265443999248,8cyclictest131rcu_preempt10:30:172
265443999244,8cyclictest131rcu_preempt07:45:012
2654439992418,3cyclictest0-21swapper/209:00:152
265443699246,12cyclictest24-21ksoftirqd/108:12:351
265443699241,16cyclictest2677814-21/usr/sbin/munin08:15:211
265443999238,3cyclictest131rcu_preempt07:25:012
2654439992313,7cyclictest32-21ksoftirqd/211:40:202
265443699237,9cyclictest131rcu_preempt09:15:271
265443999226,8cyclictest131rcu_preempt08:50:172
265443999226,8cyclictest131rcu_preempt08:50:172
2654439992211,5cyclictest2747533-21kworker/u8:1+events_unbound11:50:192
265443999216,8cyclictest131rcu_preempt09:25:152
265443999215,8cyclictest131rcu_preempt10:29:152
265443999214,3cyclictest131rcu_preempt07:25:202
2654439992113,5cyclictest311ktimers/207:50:142
265443999208,2cyclictest131rcu_preempt10:55:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional