You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 15:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot3s.osadl.org (updated Sat Apr 18, 2026 12:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591650,37ptp4l0-21swapper/107:05:201
119591620,40ptp4l0-21swapper/007:05:210
901325046,2sleep20-21swapper/207:05:342
850924944,2sleep30-21swapper/307:05:233
33812480,0sleep20-21swapper/207:55:172
52652440,0sleep25269-21pmu-power10:00:202
119591220,0ptp4l0-21swapper/209:45:222
119591210,0ptp4l0-21swapper/110:20:201
119591210,0ptp4l0-21swapper/008:10:200
119591190,5ptp4l14188-21cstates12:20:141
119591190,0ptp4l0-21swapper/111:20:151
119591190,0ptp4l0-21swapper/111:20:151
119591190,0ptp4l0-21swapper/108:40:141
962299180,2cyclictest0-21swapper/312:00:123
119591180,3ptp4l0-21swapper/007:30:200
9621991717,0cyclictest0-21swapper/211:55:252
119591170,0ptp4l0-21swapper/108:35:161
119591170,0ptp4l0-21swapper/107:40:011
119591160,2ptp4l7337-21sed08:05:010
119591160,1ptp4l29191-21apt-get07:45:141
119591160,1ptp4l25334-21snmp_o5powerctl07:35:210
119591160,0ptp4l241ktimersoftd/109:06:241
119591160,0ptp4l0-21swapper/112:35:181
119591160,0ptp4l0-21swapper/109:20:151
119591160,0ptp4l0-21swapper/109:10:011
119591160,0ptp4l0-21swapper/011:45:150
119591160,0ptp4l0-21swapper/010:44:560
962299150,1cyclictest25304-21cron09:40:013
119591150,1ptp4l7931-21ls11:05:240
119591150,1ptp4l6884-21df_inode10:05:121
119591150,1ptp4l5924-21apt-get12:05:140
119591150,1ptp4l4942-21snmp_o5powerctl12:00:211
119591150,1ptp4l3871-21diskstats11:00:141
119591150,1ptp4l33-21ksoftirqd/210:25:012
119591150,1ptp4l32149-21smartctl08:50:151
119591150,1ptp4l26195-21ls10:40:161
119591150,1ptp4l21693-21users10:30:230
119591150,1ptp4l20569-21ntp_states12:30:200
119591150,1ptp4l13099-21ntp_states10:15:191
119591150,1ptp4l1172-21ls07:50:240
119591150,1ptp4l11690-21df12:15:140
119591150,1ptp4l11681-21users09:10:250
119591150,1ptp4l11331-21snmp_o5powerctl07:10:221
119591150,0ptp4l0-21swapper/208:08:402
119591150,0ptp4l0-21swapper/110:35:131
119591150,0ptp4l0-21swapper/108:10:231
119591150,0ptp4l0-21swapper/107:55:121
119591150,0ptp4l0-21swapper/107:30:481
119591150,0ptp4l0-21swapper/011:25:200
119591150,0ptp4l0-21swapper/009:55:120
119591150,0ptp4l0-21swapper/008:30:140
962299140,12cyclictest0-21swapper/309:10:143
962299140,0cyclictest0-21swapper/311:20:183
962299140,0cyclictest0-21swapper/311:20:183
119591140,1ptp4l9407-21diskmemload12:05:171
119591140,1ptp4l8603-21/usr/sbin/munin08:05:191
119591140,1ptp4l7901-21tune2fs08:05:160
119591140,1ptp4l688-21snmp_o5powerctl08:50:210
119591140,1ptp4l6026-21snmp_o5powerctl09:00:221
119591140,1ptp4l388-21grep09:50:260
119591140,1ptp4l3753-21diskstats12:00:140
119591140,1ptp4l3362-21snmp_o5powerctl08:55:220
119591140,1ptp4l29506-21/usr/sbin/munin10:45:201
119591140,1ptp4l29013-21tr08:45:141
119591140,1ptp4l28819-21cut08:45:130
119591140,1ptp4l27396-21apt-get10:45:010
119591140,1ptp4l26108-21fschecks_count09:40:140
119591140,1ptp4l25337-21/usr/sbin/munin07:35:221
119591140,1ptp4l24579-21snmp_o5powerctl09:35:221
119591140,1ptp4l2397-21/usr/sbin/munin10:55:230
119591140,1ptp4l22415-21apt-get11:35:120
119591140,1ptp4l21231-21snmp_o5powerctl11:30:200
119591140,1ptp4l18840-21df07:25:150
119591140,1ptp4l18636-21tr09:25:152
119591140,1ptp4l18086-21df09:25:120
119591140,1ptp4l17391-21cstates10:25:131
119591140,1ptp4l16834-21cstates12:25:141
119591140,1ptp4l16834-21cstates12:25:141
119591140,1ptp4l16509-21/usr/sbin/munin12:25:170
119591140,1ptp4l16509-21/usr/sbin/munin12:25:170
119591140,1ptp4l16233-21fschecks_count07:20:151
119591140,1ptp4l15675-21smartctl11:20:210
119591140,1ptp4l15675-21smartctl11:20:210
119591140,1ptp4l15035-21aten2.4-expect09:20:140
119591140,1ptp4l14445-21ntp_states07:15:201
119591140,1ptp4l13237-21proc_pri10:15:200
119591140,1ptp4l12394-21aten_r9power_po09:15:140
119591140,1ptp4l12327-21df07:15:020
119591140,1ptp4l10372-21snmp_o5powerctl11:10:221
119591140,1ptp4l10130-21df07:10:140
119591140,0ptp4l0-21swapper/208:50:192
119591140,0ptp4l0-21swapper/112:34:081
119591140,0ptp4l0-21swapper/111:30:101
119591140,0ptp4l0-21swapper/110:55:141
119591140,0ptp4l0-21swapper/110:33:151
119591140,0ptp4l0-21swapper/110:10:121
119591140,0ptp4l0-21swapper/109:53:591
119591140,0ptp4l0-21swapper/109:47:431
119591140,0ptp4l0-21swapper/109:15:191
119591140,0ptp4l0-21swapper/108:20:201
119591140,0ptp4l0-21swapper/108:15:131
119591140,0ptp4l0-21swapper/012:35:200
119591140,0ptp4l0-21swapper/010:35:220
119591140,0ptp4l0-21swapper/010:20:110
119591140,0ptp4l0-21swapper/010:06:440
119591140,0ptp4l0-21swapper/010:00:170
119591140,0ptp4l0-21swapper/009:35:130
119591140,0ptp4l0-21swapper/008:40:200
277482130,1sleep233-21ksoftirqd/207:40:202
119591130,1ptp4l6423-21kworker/u8:109:05:140
119591130,0ptp4l9407-21diskmemload11:55:140
119591130,0ptp4l0-21swapper/211:40:192
119591130,0ptp4l0-21swapper/211:20:172
119591130,0ptp4l0-21swapper/211:20:172
119591130,0ptp4l0-21swapper/211:15:162
119591130,0ptp4l0-21swapper/211:10:142
119591130,0ptp4l0-21swapper/210:45:222
119591130,0ptp4l0-21swapper/210:30:012
119591130,0ptp4l0-21swapper/209:35:202
119591130,0ptp4l0-21swapper/209:30:242
119591130,0ptp4l0-21swapper/208:55:232
119591130,0ptp4l0-21swapper/208:30:192
119591130,0ptp4l0-21swapper/208:00:182
119591130,0ptp4l0-21swapper/207:25:252
119591130,0ptp4l0-21swapper/207:20:162
119591130,0ptp4l0-21swapper/207:15:232
119591130,0ptp4l0-21swapper/112:15:201
119591130,0ptp4l0-21swapper/112:10:171
119591130,0ptp4l0-21swapper/111:55:141
119591130,0ptp4l0-21swapper/111:50:161
119591130,0ptp4l0-21swapper/111:45:181
119591130,0ptp4l0-21swapper/111:40:131
119591130,0ptp4l0-21swapper/111:35:141
119591130,0ptp4l0-21swapper/111:25:131
119591130,0ptp4l0-21swapper/111:15:151
119591130,0ptp4l0-21swapper/111:05:141
119591130,0ptp4l0-21swapper/110:50:151
119591130,0ptp4l0-21swapper/110:00:131
119591130,0ptp4l0-21swapper/109:55:151
119591130,0ptp4l0-21swapper/109:40:131
119591130,0ptp4l0-21swapper/109:30:131
119591130,0ptp4l0-21swapper/109:25:131
119591130,0ptp4l0-21swapper/108:55:161
119591130,0ptp4l0-21swapper/108:30:151
119591130,0ptp4l0-21swapper/108:25:141
119591130,0ptp4l0-21swapper/108:00:161
119591130,0ptp4l0-21swapper/107:50:181
119591130,0ptp4l0-21swapper/107:25:161
119591130,0ptp4l0-21swapper/012:20:180
119591130,0ptp4l0-21swapper/012:10:180
119591130,0ptp4l0-21swapper/011:50:190
119591130,0ptp4l0-21swapper/011:40:200
119591130,0ptp4l0-21swapper/011:15:180
119591130,0ptp4l0-21swapper/011:10:140
119591130,0ptp4l0-21swapper/010:50:220
119591130,0ptp4l0-21swapper/010:25:160
119591130,0ptp4l0-21swapper/010:10:140
119591130,0ptp4l0-21swapper/009:45:240
119591130,0ptp4l0-21swapper/009:30:140
119591130,0ptp4l0-21swapper/009:00:140
119591130,0ptp4l0-21swapper/008:35:150
119591130,0ptp4l0-21swapper/008:25:140
119591130,0ptp4l0-21swapper/008:20:140
119591130,0ptp4l0-21swapper/008:15:220
119591130,0ptp4l0-21swapper/007:55:120
119591130,0ptp4l0-21swapper/007:45:010
119591130,0ptp4l0-21swapper/007:40:140
119591130,0ptp4l0-21swapper/007:20:140
962299127,4cyclictest22021-21cat12:35:143
962299126,5cyclictest23840-21egrep07:35:143
962299126,5cyclictest14294-21head09:15:253
962299120,1cyclictest0-21swapper/310:10:193
962299120,11cyclictest0-21swapper/307:30:223
119591120,0ptp4l0-21swapper/212:05:162
119591120,0ptp4l0-21swapper/211:35:242
119591120,0ptp4l0-21swapper/211:00:162
119591120,0ptp4l0-21swapper/209:55:172
119591120,0ptp4l0-21swapper/208:45:142
119591120,0ptp4l0-21swapper/208:20:172
119591120,0ptp4l0-21swapper/011:00:130
962299116,4cyclictest547-21basename11:55:123
962299116,4cyclictest2088-21basename07:55:123
962299116,4cyclictest19552-21basename11:30:103
962299116,4cyclictest12585-21cut08:15:013
962299115,5cyclictest9042-21cut08:05:223
962299115,5cyclictest2484-21ntpq09:55:193
962299115,5cyclictest15181-21tr09:20:143
962299110,0cyclictest0-21swapper/311:10:133
119591110,0ptp4l0-21swapper/208:25:562
962299106,3cyclictest284472sleep308:43:423
962299105,5cyclictest14314-21mailstats08:15:223
962299105,4cyclictest3761-21chrt08:55:553
962299105,4cyclictest32672-21seq10:52:183
962299105,4cyclictest19205-21chrt11:28:443
962299105,4cyclictest18665-21chrt12:26:373
962299105,4cyclictest18665-21chrt12:26:373
962299105,4cyclictest11755-21grep12:15:143
962299104,5cyclictest14301-21expr12:20:143
962299102,7cyclictest20762-21ps12:30:213
119591100,1ptp4l0-21swapper/209:12:102
119591100,0ptp4l0-21swapper/308:01:093
119591100,0ptp4l0-21swapper/210:10:202
119591100,0ptp4l0-21swapper/209:54:562
96229997,1cyclictest6827-21expr10:05:123
96229997,1cyclictest4511-21cat10:00:163
96229997,1cyclictest31274-21seq07:46:033
96229997,1cyclictest28069-21expr10:45:133
96229997,1cyclictest26699-21cat10:40:223
96229997,1cyclictest26585-21tr11:40:203
96229997,1cyclictest15948-21cut07:20:143
96229995,3cyclictest137652sleep310:15:343
96229994,4cyclictest543-21chrt09:51:403
96229994,4cyclictest29219-21awk11:45:203
96229994,4cyclictest24687-21taskset10:39:423
96229994,4cyclictest22723-21chrt08:31:053
96229994,4cyclictest22403-21taskset09:31:473
96229993,5cyclictest4777-21ntpq11:00:193
96229993,5cyclictest23798-21grep08:35:163
96229993,5cyclictest20122-21cut09:30:013
96229993,5cyclictest17809-21cat08:25:013
96229993,5cyclictest12548-21expr11:15:183
96229990,1cyclictest6356-21expr11:05:153
96229990,1cyclictest30478-21snmp_o5powerctl08:45:233
96229990,1cyclictest26150-21fschecks_time09:40:153
96229990,1cyclictest12969-21python07:15:033
96229990,1cyclictest1085-21snmp_o5powerctl07:50:233
96219998,0cyclictest33-21ksoftirqd/210:30:192
96219997,1cyclictest81582sleep211:06:292
96219997,1cyclictest7652-21cat10:05:162
96219997,1cyclictest30552-21stty10:50:122
96219997,1cyclictest23850-21cut08:35:162
11959190,0ptp4l0-21swapper/212:35:422
11959190,0ptp4l0-21swapper/212:32:242
11959190,0ptp4l0-21swapper/212:25:572
11959190,0ptp4l0-21swapper/212:25:572
11959190,0ptp4l0-21swapper/212:20:262
11959190,0ptp4l0-21swapper/212:15:032
11959190,0ptp4l0-21swapper/212:12:352
11959190,0ptp4l0-21swapper/212:04:182
11959190,0ptp4l0-21swapper/211:51:072
11959190,0ptp4l0-21swapper/211:48:252
11959190,0ptp4l0-21swapper/211:27:242
11959190,0ptp4l0-21swapper/210:59:192
11959190,0ptp4l0-21swapper/210:44:482
11959190,0ptp4l0-21swapper/210:17:332
11959190,0ptp4l0-21swapper/209:40:252
11959190,0ptp4l0-21swapper/209:15:072
11959190,0ptp4l0-21swapper/209:01:132
11959190,0ptp4l0-21swapper/208:15:382
11959190,0ptp4l0-21swapper/208:10:282
11959190,0ptp4l0-21swapper/207:50:492
11959190,0ptp4l0-21swapper/207:45:342
11959190,0ptp4l0-21swapper/207:32:222
96229986,1cyclictest4684-21expr09:00:153
96229986,1cyclictest32310-21cat08:50:173
96229986,1cyclictest27049-21basename07:40:163
96229986,1cyclictest24064-21tr11:35:213
96229986,1cyclictest20306-21chrt08:29:013
96229986,1cyclictest20089-21ls10:30:143
96229986,1cyclictest1883-21sort10:55:183
96229986,1cyclictest18506-21egrep07:25:153
96229986,1cyclictest18273-21cat10:25:183
96229986,1cyclictest10122-21expr07:10:143
96229982,5cyclictest6098-21egrep12:05:153
96229980,1cyclictest226-21systemd-journal11:50:013
96229980,1cyclictest0-21swapper/309:05:153
96229980,0cyclictest28234-21apt-get09:45:233
96229980,0cyclictest0-21swapper/310:20:113
96219986,1cyclictest7006-21dpkg09:05:132
96219986,1cyclictest26163-21aten_r9power_cu08:40:112
96219980,3cyclictest0-21swapper/209:20:132
11959180,0ptp4l0-21swapper/312:13:003
11959180,0ptp4l0-21swapper/211:30:042
11959180,0ptp4l0-21swapper/210:36:002
11959180,0ptp4l0-21swapper/207:36:452
11959180,0ptp4l0-21swapper/207:10:082
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional