You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 17:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sun Jan 11, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2587216995447,5cyclictest2677554-21kworker/u8:1+events_unbound12:05:251
2587211995447,4cyclictest2639932-21idleruntime-cro09:40:000
2587216995342,7cyclictest1-21systemd11:50:211
2587216995138,9cyclictest2688225-21sendmail12:00:001
2587216995044,4cyclictest2645092-21kworker/u8:0+events_unbound10:05:021
2587219994937,9cyclictest311ktimers/212:05:122
2587219994827,17cyclictest0-21swapper/208:30:002
2587219994740,4cyclictest2636498-21idleruntime-cro09:30:002
2587224994635,7cyclictest2590695-21grep07:15:283
2587224994620,4cyclictest0-21swapper/310:50:263
2587224994620,4cyclictest0-21swapper/310:50:263
2587211994638,5cyclictest2699554-21idleruntime-cro12:35:000
2587224994516,6cyclictest2671288-21tune2fs11:10:153
2587216994534,7cyclictest2701241-21cron12:40:001
2587224994416,3cyclictest0-21swapper/308:40:013
2587216994435,6cyclictest2624052-21unixbench_multi08:50:251
2587219994331,8cyclictest2681382-21sendmail11:40:002
2587219994133,4cyclictest0-21swapper/211:55:002
2587219994120,4cyclictest0-21swapper/211:20:242
2587211994133,5cyclictest11-21ksoftirqd/007:45:120
2587224994016,4cyclictest2594959-21fschecks_count07:30:173
2587224993931,4cyclictest0-21swapper/309:55:013
2587219993931,4cyclictest0-21swapper/212:30:152
2587216993932,5cyclictest2689570-21kworker/u8:2+events_unbound12:10:261
2587216993930,5cyclictest0-21swapper/108:50:021
2587216993930,5cyclictest0-21swapper/108:45:011
2587216993929,5cyclictest0-21swapper/110:55:161
2587216993929,5cyclictest0-21swapper/110:55:151
2587216993929,5cyclictest0-21swapper/109:40:161
2587224993830,4cyclictest2639936-21kworker/u8:109:40:003
2587224993826,7cyclictest2701271-21idleruntime-cro12:40:003
2587219993829,5cyclictest0-21swapper/210:05:002
2587211993828,6cyclictest0-21swapper/008:20:010
2587211993730,4cyclictest2591166-21munin-plugin-st07:20:000
2587224993626,6cyclictest2691193-21grep12:05:253
2587224993621,11cyclictest391ktimers/309:05:113
2587219993629,3cyclictest0-21swapper/211:40:172
2587216993626,7cyclictest2695912-21sh12:24:591
2587216993625,6cyclictest0-21swapper/109:15:281
2587216993624,8cyclictest2634355-21grep09:20:261
2587211993624,9cyclictest2660634-21munin-run10:40:000
2587224993526,4cyclictest0-21swapper/310:15:273
2587224993525,5cyclictest2648688-21idleruntime-cro10:05:003
2587219993527,4cyclictest0-21swapper/207:50:152
2587219993526,4cyclictest0-21swapper/207:40:172
2587216993527,4cyclictest0-21swapper/110:35:011
2587216993524,7cyclictest0-21swapper/110:45:261
2587211993528,4cyclictest2626219-21cron09:00:020
2587211993527,4cyclictest0-21swapper/008:50:250
2587211993526,6cyclictest2617264-21grep08:30:260
2587211993526,5cyclictest151rcuc/008:10:120
2587211993525,6cyclictest0-21swapper/007:50:160
2587224993425,4cyclictest0-21swapper/311:10:003
2587216993426,5cyclictest2646811-21kworker/u8:1+events_unbound10:00:001
2587216993425,5cyclictest0-21swapper/112:25:261
2587216993425,4cyclictest0-21swapper/111:20:241
2587216993424,6cyclictest0-21swapper/110:20:001
2587216993423,7cyclictest0-21swapper/109:10:251
2587211993424,6cyclictest2599291-21grep07:40:260
2587211993423,7cyclictest2654030-21sshd10:20:040
2587224993325,4cyclictest0-21swapper/312:30:243
2587224993325,4cyclictest0-21swapper/308:59:483
2587219993326,4cyclictest2590698-21unixbench_multi07:15:292
2587219993326,3cyclictest0-21swapper/211:19:592
2587216993323,7cyclictest2681776-21cut11:40:161
2587216993323,7cyclictest2611896-21grep08:15:271
2587216993321,7cyclictest0-21swapper/109:05:261
2587216993320,10cyclictest2655108-21grep10:20:251
2587224993224,4cyclictest0-21swapper/310:40:153
2587219993225,4cyclictest0-21swapper/207:35:272
2587219993225,3cyclictest0-21swapper/211:30:012
2587219993219,10cyclictest311ktimers/212:25:142
258721699323,6cyclictest131rcu_preempt08:10:121
258721699322,4cyclictest131rcu_preempt11:30:111
2587216993224,4cyclictest0-21swapper/107:25:271
2587216993223,5cyclictest0-21swapper/109:00:261
2587216993223,5cyclictest0-21swapper/107:20:001
2587211993226,3cyclictest2697627-21kthreadd12:30:000
2587211993222,7cyclictest2596287-21cron07:35:000
2587224993124,3cyclictest0-21swapper/311:45:143
2587224993123,4cyclictest0-21swapper/310:40:003
2587224993123,4cyclictest0-21swapper/309:20:003
2587219993121,6cyclictest2601186-21grep07:45:292
2587216993120,8cyclictest0-21swapper/110:50:131
2587216993120,8cyclictest0-21swapper/110:50:131
2587216993118,9cyclictest204-21dbus-daemon09:54:581
2587211993126,3cyclictest0-21swapper/011:20:120
2587211993124,4cyclictest0-21swapper/007:25:270
2587211993123,6cyclictest2653475-21kworker/u8:2+events_unbound10:40:130
2587211993122,6cyclictest0-21swapper/011:00:000
2587211993122,6cyclictest0-21swapper/011:00:000
2587211993121,6cyclictest0-21swapper/010:05:000
258721199310,25cyclictest0-21swapper/008:30:020
2587224993022,4cyclictest0-21swapper/312:05:003
2587219993021,5cyclictest0-21swapper/210:15:022
2587211993023,5cyclictest2645092-21kworker/u8:0+events_unbound10:10:040
2587211993023,3cyclictest0-21swapper/010:25:270
2587211993021,6cyclictest2658461-21grep10:30:240
2587211993020,6cyclictest2634310-21grep09:20:270
2587211993019,8cyclictest204-21dbus-daemon10:45:130
2587224992923,3cyclictest0-21swapper/308:00:013
2587224992922,3cyclictest0-21swapper/311:40:153
2587224992920,4cyclictest0-21swapper/311:25:273
2587216992921,4cyclictest0-21swapper/109:35:151
2587216992917,8cyclictest2595868-21grep07:30:261
258721699290,5cyclictest131rcu_preempt12:00:121
2587211992923,3cyclictest0-21swapper/007:40:000
2587211992922,3cyclictest0-21swapper/011:40:000
2587211992921,4cyclictest0-21swapper/011:15:150
2587211992919,7cyclictest2644760-21grep09:50:250
2587224992818,6cyclictest0-21swapper/311:55:163
2587224992816,7cyclictest2601230-21head07:45:293
2587219992822,3cyclictest0-21swapper/208:00:272
2587219992820,4cyclictest0-21swapper/210:45:262
2587219992818,6cyclictest2667005-21grep10:55:252
2587219992818,6cyclictest2667005-21grep10:55:252
2587216992821,4cyclictest2603554-21grep07:55:021
2587216992818,6cyclictest0-21swapper/111:10:261
2587216992815,10cyclictest164-21systemd-journal08:36:401
2587211992822,3cyclictest0-21swapper/009:25:120
2587211992819,6cyclictest0-21swapper/009:45:270
2587224992719,4cyclictest0-21swapper/309:55:183
2587224992719,4cyclictest0-21swapper/308:15:173
2587224992718,5cyclictest0-21swapper/309:25:153
258721999273,21cyclictest2686946-21fschecks_time11:55:162
2587219992720,3cyclictest0-21swapper/208:45:262
2587219992719,4cyclictest0-21swapper/210:20:162
258721999271,15cyclictest0-21swapper/207:57:002
2587216992719,5cyclictest2615136-21timerandwakeup08:25:261
2587216992717,8cyclictest2598008-21cron07:40:001
258721699271,3cyclictest2655754-21apt-get10:25:141
2587211992719,4cyclictest0-21swapper/007:20:250
2587211992719,4cyclictest0-21swapper/007:20:250
258721199271,22cyclictest2622380-21grep08:45:260
258722499263,4cyclictest131rcu_preempt09:45:003
2587224992619,4cyclictest2649953-21head10:05:263
2587224992617,4cyclictest2643535-21cron09:50:003
2587224992616,7cyclictest2636838-21diskstats09:30:153
2587224992616,6cyclictest2627525-21grep09:00:273
2587224992615,8cyclictest2589090-21cat07:15:023
2587224992615,8cyclictest1-21systemd10:20:043
2587219992621,3cyclictest0-21swapper/208:35:002
2587219992616,6cyclictest2632593-21grep09:15:262
258721999261,22cyclictest2661470-21open_files10:40:212
258721699263,6cyclictest131rcu_preempt08:30:121
2587216992619,4cyclictest2587936-21ntpq07:10:241
2587216992619,4cyclictest0-21swapper/111:30:011
2587216992617,6cyclictest2605746-21tune2fs08:00:171
2587216992617,5cyclictest0-21swapper/111:00:141
2587216992617,5cyclictest0-21swapper/111:00:141
2587216992616,7cyclictest231ktimers/110:10:111
2587216992616,6cyclictest0-21swapper/107:40:161
2587216992615,7cyclictest0-21swapper/111:35:251
2587216992614,9cyclictest2613634-21grep08:20:261
258721199263,4cyclictest2637284-21ntp_states09:30:210
2587211992619,3cyclictest0-21swapper/010:20:000
2587211992618,4cyclictest0-21swapper/009:55:280
2587224992519,3cyclictest0-21swapper/307:55:013
2587224992517,4cyclictest0-21swapper/312:25:163
2587224992516,6cyclictest1-21systemd11:35:203
2587224992515,7cyclictest2666305-21cat10:55:163
2587224992515,7cyclictest2666305-21cat10:55:163
2587224992514,8cyclictest2615970-21sed08:30:013
2587219992518,5cyclictest2667233-21kworker/u8:0+events_unbound11:10:132
2587219992518,4cyclictest2612327-21sh08:20:012
2587219992518,4cyclictest0-21swapper/209:35:262
2587219992518,3cyclictest0-21swapper/211:30:202
2587219992517,5cyclictest0-21swapper/210:35:252
2587219992514,8cyclictest2589127-21sort07:15:012
2587216992519,3cyclictest0-21swapper/111:05:141
2587216992517,5cyclictest0-21swapper/107:45:301
2587216992516,6cyclictest0-21swapper/108:00:011
2587216992515,6cyclictest0-21swapper/107:20:251
2587216992515,6cyclictest0-21swapper/107:20:251
2587216992514,7cyclictest2660161-21grep10:35:261
258721199257,3cyclictest2671814-21rt-features11:10:230
2587211992518,3cyclictest0-21swapper/007:10:190
2587211992517,5cyclictest121ktimers/012:05:220
2587211992517,5cyclictest11-21ksoftirqd/008:40:120
2587211992517,4cyclictest2683480-21grep11:45:150
2587211992516,6cyclictest2670426-21grep11:05:270
2587211992515,7cyclictest2605289-21sendmail08:00:020
258721199251,21cyclictest2687840-21seq11:55:390
2587224992418,3cyclictest0-21swapper/312:20:123
2587224992418,3cyclictest0-21swapper/312:10:133
2587224992418,3cyclictest0-21swapper/310:50:013
2587224992415,6cyclictest2610566-21sed08:15:013
2587224992415,5cyclictest0-21swapper/307:44:323
2587219992418,3cyclictest0-21swapper/210:25:162
2587219992418,3cyclictest0-21swapper/210:05:262
2587219992418,3cyclictest0-21swapper/208:55:182
2587219992418,3cyclictest0-21swapper/207:25:262
2587219992415,6cyclictest2658490-21grep10:30:242
2587219992415,5cyclictest2694196-21cat12:19:592
2587219992412,9cyclictest2629685-21seq09:10:022
2587216992418,4cyclictest2629449-21kworker/u8:0+events_unbound09:27:501
2587216992418,3cyclictest0-21swapper/112:30:141
2587216992418,3cyclictest0-21swapper/111:15:221
2587216992418,3cyclictest0-21swapper/109:30:171
2587216992415,4cyclictest0-21swapper/109:45:261
2587211992418,4cyclictest2699150-21kworker/u8:3+events_unbound12:35:290
2587211992415,5cyclictest0-21swapper/009:20:010
2587211992413,8cyclictest204-21dbus-daemon11:25:190
258721199241,19cyclictest0-21swapper/010:07:070
258721199241,19cyclictest0-21swapper/009:13:580
2587224992317,3cyclictest0-21swapper/308:45:203
2587224992316,4cyclictest2633447-21fschecks_count09:20:163
2587224992316,4cyclictest0-21swapper/309:10:153
2587224992315,4cyclictest0-21swapper/310:25:273
2587224992315,4cyclictest0-21swapper/308:40:153
2587219992317,3cyclictest0-21swapper/212:10:112
2587219992317,3cyclictest0-21swapper/209:40:022
2587219992317,3cyclictest0-21swapper/208:35:202
2587219992317,3cyclictest0-21swapper/207:30:162
2587219992317,3cyclictest0-21swapper/207:20:122
2587219992317,3cyclictest0-21swapper/207:20:122
2587219992315,5cyclictest2669598-21uniq11:05:172
2587219992314,5cyclictest0-21swapper/209:00:262
2587216992317,4cyclictest2658560-21kworker/u8:3+events_unbound10:41:441
2587216992316,5cyclictest2693340-21kworker/u8:1+events_unbound12:19:561
2587216992315,5cyclictest0-21swapper/111:50:001
2587211992319,2cyclictest13550irq/42-30be0000.ethernet09:00:120
2587211992315,5cyclictest121ktimers/011:00:180
2587211992315,5cyclictest121ktimers/011:00:170
2587211992315,4cyclictest0-21swapper/008:05:020
258721199231,18cyclictest0-21swapper/012:24:440
258721199231,18cyclictest0-21swapper/010:50:070
258721199231,18cyclictest0-21swapper/010:50:070
258721199231,18cyclictest0-21swapper/009:43:540
258721199231,18cyclictest0-21swapper/008:36:590
258721199231,18cyclictest0-21swapper/008:20:380
258721199230,19cyclictest0-21swapper/011:54:250
2587224992216,3cyclictest0-21swapper/308:05:143
2587224992216,3cyclictest0-21swapper/307:25:213
2587224992215,4cyclictest2673897-21head11:15:263
2587224992215,4cyclictest0-21swapper/308:00:283
2587224992214,4cyclictest0-21swapper/311:20:233
2587219992216,3cyclictest0-21swapper/210:15:012
2587219992216,3cyclictest0-21swapper/209:55:232
2587219992216,3cyclictest0-21swapper/209:10:252
2587219992214,5cyclictest0-21swapper/208:50:252
2587216992215,3cyclictest0-21swapper/110:00:191
2587216992214,4cyclictest2624922-21fschecks_time08:55:161
2587211992215,4cyclictest0-21swapper/012:00:260
258721199220,18cyclictest0-21swapper/012:11:590
258721199220,18cyclictest0-21swapper/011:43:150
258721199220,18cyclictest0-21swapper/009:07:400
258722499217,3cyclictest131rcu_preempt07:35:483
2587224992116,2cyclictest0-21swapper/311:50:203
2587224992115,4cyclictest391ktimers/308:50:133
2587224992115,3cyclictest0-21swapper/310:35:003
2587224992115,3cyclictest0-21swapper/310:10:163
2587224992114,3cyclictest0-21swapper/308:20:183
2587224992111,7cyclictest2616196-21apt-get08:30:133
2587219992115,3cyclictest0-21swapper/209:20:262
2587219992114,4cyclictest2683503-21fschecks_time11:45:142
2587219992114,3cyclictest0-21swapper/209:45:162
2587219992113,4cyclictest2695461-21grep12:20:212
258721199211,3cyclictest0-21swapper/008:08:330
258721199211,18cyclictest0-21swapper/012:17:580
258721199210,17cyclictest0-21swapper/011:31:340
258722499208,7cyclictest204-21dbus-daemon12:15:263
2587224992013,4cyclictest0-21swapper/311:30:143
258721999208,9cyclictest2637067-21cut09:30:182
2587219992014,4cyclictest311ktimers/210:50:152
2587219992014,4cyclictest311ktimers/210:50:142
2587219992014,3cyclictest0-21swapper/212:35:252
2587219992013,4cyclictest311ktimers/208:10:262
2587219992012,6cyclictest2667976-21ls11:00:172
2587219992012,6cyclictest2667976-21ls11:00:172
2587219992010,7cyclictest2688812-21sed12:00:192
258722499193,3cyclictest131rcu_preempt07:20:123
258722499193,3cyclictest131rcu_preempt07:20:123
258721999199,6cyclictest2620140-21expr08:40:212
258721999198,8cyclictest2607300-21cat08:05:132
2587219991913,4cyclictest2612788-21fschecks_time08:20:162
258722499182,12cyclictest2667730-21sshd11:00:153
258722499182,12cyclictest2667730-21sshd11:00:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional