You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-21 - 18:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot3s.osadl.org (updated Sun Jun 21, 2026 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591610,42ptp4l0-21swapper/007:08:240
119591610,39ptp4l0-21swapper/107:05:511
119591540,30ptp4l0-21swapper/207:05:182
1686525242,7sleep30-21swapper/307:05:133
93532430,0sleep30-21swapper/308:50:133
24482430,0sleep10-21swapper/107:35:171
119591200,1ptp4l25-21ksoftirqd/109:50:201
119591190,0ptp4l0-21swapper/012:35:180
119591190,0ptp4l0-21swapper/010:05:200
119591180,0ptp4l0-21swapper/112:25:231
119591180,0ptp4l0-21swapper/107:45:191
119591180,0ptp4l0-21swapper/008:05:210
119591170,1ptp4l32646-21apt-get10:35:120
119591170,0ptp4l0-21swapper/110:45:241
119591170,0ptp4l0-21swapper/109:40:161
119591170,0ptp4l0-21swapper/010:40:230
119591170,0ptp4l0-21swapper/007:30:220
119591160,1ptp4l899-21hddtemp_smartct10:35:151
119591160,1ptp4l5305-21ls07:40:170
119591160,1ptp4l32579-21snmp_o5powerctl07:30:221
119591160,1ptp4l25077-21apt-get09:20:110
119591160,1ptp4l24239-21snmp_o5powerctl08:15:221
119591160,1ptp4l23786-21ntp_states09:15:180
119591160,1ptp4l20013-21ls11:10:171
119591160,1ptp4l15144-21hddtemp_smartct09:00:160
119591160,0ptp4l0-21swapper/111:45:191
119591160,0ptp4l0-21swapper/111:05:141
119591160,0ptp4l0-21swapper/110:40:131
119591160,0ptp4l0-21swapper/109:45:131
119591160,0ptp4l0-21swapper/008:20:130
119591150,1ptp4l9485-21snmp_o5powerctl11:50:220
119591150,1ptp4l8487-21ls07:45:220
119591150,1ptp4l723-21latency_hist08:35:010
119591150,1ptp4l723-21latency_hist08:35:010
119591150,1ptp4l32037-21munin-run11:35:011
119591150,1ptp4l30709-21snmp_o5powerctl12:30:210
119591150,1ptp4l3017-21perf09:40:010
119591150,1ptp4l29923-21snmp_o5powerctl07:25:200
119591150,1ptp4l28891-21/usr/sbin/munin10:25:210
119591150,1ptp4l27849-21phc2sys-jitter12:25:190
119591150,1ptp4l27448-21df11:25:131
119591150,1ptp4l27277-21python07:20:210
119591150,1ptp4l25785-21/usr/sbin/munin09:20:141
119591150,1ptp4l24862-21irqstats12:20:162
119591150,1ptp4l2355-21ntp_states08:35:201
119591150,1ptp4l22465-21ntp_states12:15:191
119591150,1ptp4l21224-21snmp_o5powerctl07:10:220
119591150,1ptp4l21156-21missed_timers08:10:180
119591150,1ptp4l19427-21cut10:10:150
119591150,1ptp4l19108-21hddtemp_smartct12:10:141
119591150,1ptp4l17961-21smartctl08:05:171
119591150,1ptp4l16995-21df10:05:171
119591150,1ptp4l1674-21latency_hist12:40:011
119591150,1ptp4l16124-21/usr/sbin/munin11:05:150
119591150,1ptp4l13885-21cat11:00:130
119591150,1ptp4l10557-21sed07:50:190
119591150,1ptp4l1054-21df09:35:121
119591150,0ptp4l17584-21diskstats09:05:150
119591150,0ptp4l0-21swapper/211:05:182
119591150,0ptp4l0-21swapper/112:30:131
119591150,0ptp4l0-21swapper/112:00:121
119591150,0ptp4l0-21swapper/111:58:031
119591150,0ptp4l0-21swapper/111:50:221
119591150,0ptp4l0-21swapper/109:15:151
119591150,0ptp4l0-21swapper/109:05:131
119591150,0ptp4l0-21swapper/109:00:011
119591150,0ptp4l0-21swapper/108:59:311
119591150,0ptp4l0-21swapper/108:27:251
119591150,0ptp4l0-21swapper/107:15:191
119591150,0ptp4l0-21swapper/107:10:021
119591150,0ptp4l0-21swapper/012:10:110
119591150,0ptp4l0-21swapper/010:50:110
119591150,0ptp4l0-21swapper/009:10:110
119591140,1ptp4l8876-21hddtemp_smartct10:50:151
119591140,1ptp4l6318-21if_enp3s010:45:170
119591140,1ptp4l27855-21/usr/sbin/munin08:25:160
119591140,1ptp4l24494-21if_enp0s31f612:20:160
119591140,1ptp4l1764-21if_enp4s008:35:180
119591140,1ptp4l11711-21interrupts10:55:171
119591140,0ptp4l26255-21gltestperf07:20:151
119591140,0ptp4l23689-21if_enp0s31f607:15:180
119591140,0ptp4l21554-21df_inode12:15:130
119591140,0ptp4l0-21swapper/210:05:282
119591140,0ptp4l0-21swapper/208:25:222
119591140,0ptp4l0-21swapper/112:20:131
119591140,0ptp4l0-21swapper/112:05:141
119591140,0ptp4l0-21swapper/111:40:151
119591140,0ptp4l0-21swapper/111:20:181
119591140,0ptp4l0-21swapper/111:15:141
119591140,0ptp4l0-21swapper/110:30:161
119591140,0ptp4l0-21swapper/110:25:131
119591140,0ptp4l0-21swapper/110:20:141
119591140,0ptp4l0-21swapper/110:10:161
119591140,0ptp4l0-21swapper/109:30:141
119591140,0ptp4l0-21swapper/109:25:241
119591140,0ptp4l0-21swapper/109:10:121
119591140,0ptp4l0-21swapper/108:50:151
119591140,0ptp4l0-21swapper/108:45:131
119591140,0ptp4l0-21swapper/108:40:141
119591140,0ptp4l0-21swapper/108:30:241
119591140,0ptp4l0-21swapper/108:30:231
119591140,0ptp4l0-21swapper/108:20:071
119591140,0ptp4l0-21swapper/108:10:121
119591140,0ptp4l0-21swapper/108:00:141
119591140,0ptp4l0-21swapper/107:55:121
119591140,0ptp4l0-21swapper/107:50:211
119591140,0ptp4l0-21swapper/107:40:211
119591140,0ptp4l0-21swapper/107:25:121
119591140,0ptp4l0-21swapper/012:05:140
119591140,0ptp4l0-21swapper/012:00:170
119591140,0ptp4l0-21swapper/011:45:130
119591140,0ptp4l0-21swapper/011:40:200
119591140,0ptp4l0-21swapper/011:35:130
119591140,0ptp4l0-21swapper/011:30:140
119591140,0ptp4l0-21swapper/011:20:200
119591140,0ptp4l0-21swapper/011:15:010
119591140,0ptp4l0-21swapper/011:10:240
119591140,0ptp4l0-21swapper/010:55:240
119591140,0ptp4l0-21swapper/010:30:170
119591140,0ptp4l0-21swapper/010:20:230
119591140,0ptp4l0-21swapper/009:55:190
119591140,0ptp4l0-21swapper/009:50:230
119591140,0ptp4l0-21swapper/009:45:230
119591140,0ptp4l0-21swapper/009:40:170
119591140,0ptp4l0-21swapper/009:30:240
119591140,0ptp4l0-21swapper/009:25:220
119591140,0ptp4l0-21swapper/008:55:130
119591140,0ptp4l0-21swapper/008:45:220
119591140,0ptp4l0-21swapper/007:55:130
119591140,0ptp4l0-21swapper/007:35:180
119591130,0ptp4l0-21swapper/212:10:162
119591130,0ptp4l0-21swapper/211:55:142
119591130,0ptp4l0-21swapper/211:35:152
119591130,0ptp4l0-21swapper/210:50:162
119591130,0ptp4l0-21swapper/209:55:152
119591130,0ptp4l0-21swapper/209:50:202
119591130,0ptp4l0-21swapper/208:22:192
119591130,0ptp4l0-21swapper/207:50:252
119591130,0ptp4l0-21swapper/111:35:011
119591130,0ptp4l0-21swapper/111:00:121
119591130,0ptp4l0-21swapper/110:15:151
119591130,0ptp4l0-21swapper/110:00:131
119591130,0ptp4l0-21swapper/109:55:141
119591130,0ptp4l0-21swapper/011:55:140
119591130,0ptp4l0-21swapper/011:25:020
119591130,0ptp4l0-21swapper/010:15:020
119591130,0ptp4l0-21swapper/010:00:140
119591130,0ptp4l0-21swapper/008:50:130
119591130,0ptp4l0-21swapper/008:40:130
119591130,0ptp4l0-21swapper/008:15:010
119591130,0ptp4l0-21swapper/008:00:130
1950499120,7cyclictest0-21swapper/207:45:112
119591120,0ptp4l0-21swapper/211:20:222
119591120,0ptp4l0-21swapper/207:55:112
19505991111,0cyclictest41-21ksoftirqd/307:55:163
119591110,0ptp4l0-21swapper/209:00:372
1950599107,2cyclictest1832-21wc10:35:203
188992100,1sleep30-21swapper/308:05:223
119591100,0ptp4l0-21swapper/209:26:312
119591100,0ptp4l0-21swapper/208:14:562
195059999,0cyclictest41-21ksoftirqd/311:10:203
195059997,1cyclictest6426-21interrupts10:45:183
195059997,1cyclictest4938-21snmp_o5powerctl09:40:213
195059997,1cyclictest41-21ksoftirqd/312:05:143
195059997,1cyclictest30727-21tr11:30:153
195059997,1cyclictest29535-21date07:25:163
195059997,1cyclictest2834-21cut07:35:213
195059997,1cyclictest26909-21grep07:20:183
195059997,1cyclictest26044-21chrt12:23:483
195059997,1cyclictest18892-21seq10:09:453
195059997,1cyclictest16122-21head08:00:203
195059997,1cyclictest13406-21taskset09:57:323
195059997,1cyclictest1258-21seq08:35:163
195059993,4cyclictest9632-21phc2sys-jitter10:50:193
195059990,8cyclictest25308-21cut08:20:133
195049997,1cyclictest831-21cut09:35:132
195049997,1cyclictest7864-21tail09:45:242
195049997,1cyclictest4497-21fgrep10:40:212
195049997,1cyclictest30986-21tr08:30:152
195049997,1cyclictest30986-21tr08:30:142
195049997,1cyclictest30808-21cat11:30:152
195049997,1cyclictest22337-21snmp_o5powerctl07:15:012
195049997,1cyclictest112022sleep208:53:242
195049990,8cyclictest4782-21tr09:40:202
11959190,1ptp4l0-21swapper/211:13:052
11959190,0ptp4l0-21swapper/212:37:312
11959190,0ptp4l0-21swapper/212:33:262
11959190,0ptp4l0-21swapper/212:26:262
11959190,0ptp4l0-21swapper/212:16:352
11959190,0ptp4l0-21swapper/212:09:392
11959190,0ptp4l0-21swapper/212:00:482
11959190,0ptp4l0-21swapper/211:51:532
11959190,0ptp4l0-21swapper/211:48:072
11959190,0ptp4l0-21swapper/211:26:472
11959190,0ptp4l0-21swapper/211:18:542
11959190,0ptp4l0-21swapper/211:02:262
11959190,0ptp4l0-21swapper/210:55:472
11959190,0ptp4l0-21swapper/210:49:462
11959190,0ptp4l0-21swapper/210:36:112
11959190,0ptp4l0-21swapper/210:31:292
11959190,0ptp4l0-21swapper/210:25:302
11959190,0ptp4l0-21swapper/210:18:522
11959190,0ptp4l0-21swapper/210:01:232
11959190,0ptp4l0-21swapper/209:31:322
11959190,0ptp4l0-21swapper/209:15:292
11959190,0ptp4l0-21swapper/209:12:252
11959190,0ptp4l0-21swapper/209:05:022
11959190,0ptp4l0-21swapper/208:56:242
11959190,0ptp4l0-21swapper/208:41:222
11959190,0ptp4l0-21swapper/208:36:252
11959190,0ptp4l0-21swapper/208:19:052
11959190,0ptp4l0-21swapper/208:05:432
11959190,0ptp4l0-21swapper/208:04:252
11959190,0ptp4l0-21swapper/207:40:252
11959190,0ptp4l0-21swapper/207:26:572
11959190,0ptp4l0-21swapper/207:22:272
11959190,0ptp4l0-21swapper/207:10:432
195059987,0cyclictest41-21ksoftirqd/312:10:133
195059986,1cyclictest9794-21ls09:50:193
195059986,1cyclictest9530-21tr07:50:153
195059986,1cyclictest8150-21expr11:50:143
195059986,1cyclictest7900-21cat07:45:163
195059986,1cyclictest686-21if_err_enp4s011:35:163
195059986,1cyclictest6400-21cut08:45:123
195059986,1cyclictest6236-21sed11:45:153
195059986,1cyclictest6190-21grep09:45:153
195059986,1cyclictest48362sleep311:44:003
195059986,1cyclictest4684-21grep07:40:143
195059986,1cyclictest4579-21tr08:40:163
195059986,1cyclictest32055-21expr12:35:143
195059986,1cyclictest3191-21cat10:40:153
195059986,1cyclictest31420-21tune2fs07:30:163
195059986,1cyclictest30951-21tr08:30:143
195059986,1cyclictest30951-21tr08:30:143
195059986,1cyclictest30593-21tr09:30:153
195059986,1cyclictest29916-21egrep10:30:133
195059986,1cyclictest29558-21fschecks_count12:30:153
195059986,1cyclictest28510-21if_enp4s009:25:153
195059986,1cyclictest28359-21df08:25:153
195059986,1cyclictest27142-21dpkg10:25:103
195059986,1cyclictest27054-21sed12:25:153
195059986,1cyclictest26956-21basename11:25:123
195059986,1cyclictest26289-21ls10:20:223
195059986,1cyclictest25286-21cut11:20:163
195059986,1cyclictest23484-21tr08:15:173
195059986,1cyclictest23299-21expr07:15:163
195059986,1cyclictest22765-21expr09:15:133
195059986,1cyclictest22342-21fschecks_count10:15:163
195059986,1cyclictest22015-21taskset08:11:123
195059986,1cyclictest21695-21telnet11:15:133
195059986,1cyclictest21351-21tr12:15:133
195059986,1cyclictest21236-21cut09:10:193
195059986,1cyclictest20606-21tr07:10:173
195059986,1cyclictest19614-21cat10:10:153
195059986,1cyclictest18572-21cut09:05:203
195059986,1cyclictest18388-21taskset11:08:033
195059986,1cyclictest1723-21cut09:35:153
195059986,1cyclictest16591-21chrt09:01:433
195059986,1cyclictest14678-21wc11:00:173
195059986,1cyclictest14102-21tr10:00:153
195059986,1cyclictest13412-21ls12:00:133
195059986,1cyclictest11544-21taskset08:55:053
195059986,1cyclictest11243-21mii-tool11:55:143
195059986,1cyclictest11050-21expr10:55:153
195049986,1cyclictest6257-21taskset08:45:112
195049986,1cyclictest30914-21cut07:30:132
195049986,1cyclictest25432-21cut10:20:162
195049986,1cyclictest2489-21chrt11:40:062
195049986,1cyclictest1352-21apt07:35:132
11959180,0ptp4l0-21swapper/210:10:092
11959180,0ptp4l0-21swapper/209:20:042
195059975,1cyclictest25177-21cut09:20:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional