You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 00:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Tue Dec 23, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3551211692,19sleep00-21swapper/007:09:040
2414211287,17sleep30-21swapper/307:05:163
3620210696,6sleep10-21swapper/107:09:581
3354210695,6sleep20-21swapper/207:06:302
25702700,0sleep20-21swapper/210:43:402
259372670,0sleep30-21swapper/311:49:353
240872630,4sleep1365199cyclictest11:09:011
161812210,1sleep20-21swapper/211:00:002
3653991916,2cyclictest6303-21kworker/u8:009:20:053
3653991916,2cyclictest6303-21kworker/u8:009:16:063
3653991916,2cyclictest23352-21kworker/u8:010:56:063
3653991916,2cyclictest18974-21kworker/u8:011:10:053
3653991916,2cyclictest18974-21kworker/u8:011:10:053
3650991916,2cyclictest26509-21kworker/u8:111:56:050
3653991815,2cyclictest8141-21kworker/u8:110:52:053
3653991815,2cyclictest29882-21kworker/u8:110:37:053
3653991815,2cyclictest18974-21kworker/u8:011:04:053
3652991815,2cyclictest4682-21kworker/u8:012:22:052
3652991815,2cyclictest4682-21kworker/u8:012:22:052
211732180,1sleep10-21swapper/107:50:161
3653991714,2cyclictest9565-21kworker/u8:208:08:043
3653991714,2cyclictest4682-21kworker/u8:012:07:053
3653991714,2cyclictest32481-21kworker/u8:209:36:053
3653991714,2cyclictest32481-21kworker/u8:209:31:053
3653991714,2cyclictest32481-21kworker/u8:209:25:033
3653991714,2cyclictest22162-21kworker/u8:009:58:043
3653991714,2cyclictest16403-21kworker/u8:212:10:053
3652991714,2cyclictest22843-21kworker/u8:209:13:052
3650991714,2cyclictest2788-21kworker/u8:210:45:050
3653991613,2cyclictest9565-21kworker/u8:207:48:043
3653991613,2cyclictest3998-21kworker/u8:110:13:043
3653991613,2cyclictest26617-21kworker/u8:111:41:053
3653991613,2cyclictest22676-21kworker/u8:212:25:053
3653991613,2cyclictest22162-21kworker/u8:009:52:043
3653991613,2cyclictest18567-21kworker/u8:109:11:043
3653991613,2cyclictest14099-21kworker/u8:110:26:053
3653991613,2cyclictest12022-21kworker/u8:011:33:053
3653991613,2cyclictest10094-21apt-get07:25:103
365399161,2cyclictest23367-21apt-get10:30:103
365399161,13cyclictest19742-21iostat12:20:143
365399161,13cyclictest19742-21iostat12:20:143
365399160,14cyclictest16403-21kworker/u8:212:00:213
365399160,14cyclictest0-21swapper/311:50:333
3651991613,2cyclictest3998-21kworker/u8:110:06:051
365199160,14cyclictest0-21swapper/112:00:161
365099161,3cyclictest9989-21hddtemp_smartct09:35:160
3650991613,2cyclictest9565-21kworker/u8:208:05:040
3650991613,2cyclictest8141-21kworker/u8:110:54:050
3650991613,2cyclictest4682-21kworker/u8:012:15:040
3650991613,2cyclictest14213-21kworker/u8:211:16:050
365099161,13cyclictest2867-21ssh12:39:180
365099160,3cyclictest0-21swapper/011:05:170
164282160,0sleep20-21swapper/210:20:282
3653991512,2cyclictest913-21kworker/u8:012:37:043
3653991512,2cyclictest6303-21kworker/u8:009:04:043
3653991512,2cyclictest3998-21kworker/u8:110:09:053
3653991512,2cyclictest2568-21kworker/u8:007:18:043
3653991512,2cyclictest2143-21kworker/u8:208:35:053
3653991512,2cyclictest18974-21kworker/u8:011:09:043
3653991512,2cyclictest11598-21kworker/u8:007:31:043
3653991512,2cyclictest10132-21kworker/u8:108:54:043
3653991511,2cyclictest4546-21iostat_ios07:10:183
365399150,3cyclictest6537-21cat11:25:253
365399150,3cyclictest0-21swapper/308:55:063
365399150,13cyclictest20228-21diskmemload11:59:233
365199150,13cyclictest0-21swapper/112:32:421
365199150,13cyclictest0-21swapper/110:26:561
365099151,3cyclictest3409-21ssh11:22:110
3650991512,2cyclictest22162-21kworker/u8:010:01:040
3650991510,3cyclictest0-21swapper/011:39:540
365099150,13cyclictest0-21swapper/011:45:340
246882150,3sleep024696-21rm09:15:050
3653991411,2cyclictest9565-21kworker/u8:208:12:043
3653991411,2cyclictest5168-21kworker/u8:109:47:053
3653991411,2cyclictest23352-21kworker/u8:010:41:043
3653991411,2cyclictest18567-21kworker/u8:109:06:043
3653991411,2cyclictest0-21swapper/310:47:513
3653991411,2cyclictest0-21swapper/310:21:103
365399140,13cyclictest0-21swapper/309:42:363
365399140,12cyclictest0-21swapper/311:15:103
3652991411,2cyclictest0-21swapper/210:54:132
365299140,12cyclictest32733-21processes12:35:202
365299140,12cyclictest20228-21diskmemload11:31:392
365299140,12cyclictest20228-21diskmemload11:05:152
365299140,12cyclictest0-21swapper/211:20:502
3651991411,2cyclictest22222-21kworker/u8:011:46:051
3651991411,2cyclictest20228-21diskmemload11:22:201
3651991411,2cyclictest20228-21diskmemload10:11:161
3651991411,2cyclictest14213-21kworker/u8:211:00:051
3651991411,2cyclictest0-21swapper/112:27:571
3651991411,2cyclictest0-21swapper/111:31:361
3651991411,2cyclictest0-21swapper/110:00:561
3651991411,2cyclictest0-21swapper/109:49:461
3651991411,2cyclictest0-21swapper/109:35:161
365199140,2cyclictest0-21swapper/109:54:461
365199140,2cyclictest0-21swapper/109:18:061
365199140,2cyclictest0-21swapper/109:12:461
365199140,13cyclictest0-21swapper/111:35:211
365199140,13cyclictest0-21swapper/110:51:261
365199140,13cyclictest0-21swapper/109:29:461
365199140,13cyclictest0-21swapper/107:45:161
365199140,12cyclictest0-21swapper/111:15:051
365199140,12cyclictest0-21swapper/111:12:141
365199140,12cyclictest0-21swapper/111:12:141
365199140,12cyclictest0-21swapper/110:23:311
365199140,12cyclictest0-21swapper/110:15:221
365099149,3cyclictest13104-21ssh12:12:120
3650991411,2cyclictest5168-21kworker/u8:109:33:040
3650991411,2cyclictest12692-21kworker/u8:009:40:040
3650991411,2cyclictest0-21swapper/012:28:350
365099140,13cyclictest20228-21diskmemload09:13:150
365099140,12cyclictest6168-21munin-node0
365099140,12cyclictest3186-21ps12:00:190
365099140,12cyclictest20228-21diskmemload12:20:340
365099140,12cyclictest20228-21diskmemload12:20:340
365099140,12cyclictest0-21swapper/012:31:380
365099140,12cyclictest0-21swapper/011:32:440
365099140,12cyclictest0-21swapper/009:26:340
365099140,12cyclictest0-21swapper/008:00:160
365099140,12cyclictest0-21swapper/007:55:150
365399131,3cyclictest13628-21ssh11:35:053
3653991310,2cyclictest6303-21kworker/u8:008:42:043
3653991310,2cyclictest31964-21kworker/u8:008:21:043
3653991310,2cyclictest2568-21kworker/u8:007:20:043
3653991310,2cyclictest22676-21kworker/u8:212:30:053
3653991310,2cyclictest20228-21diskmemload11:20:273
3653991310,2cyclictest0-21swapper/310:02:573
3653991310,2cyclictest0-21swapper/308:30:173
365299131,10cyclictest7458-21runrttasks09:30:592
3652991310,2cyclictest31880-21ssh11:17:382
3652991310,2cyclictest20228-21diskmemload12:31:552
3652991310,2cyclictest20228-21diskmemload11:49:482
3652991310,2cyclictest0-21swapper/212:17:102
3652991310,2cyclictest0-21swapper/212:12:012
3652991310,2cyclictest0-21swapper/211:38:282
365299130,2cyclictest26977-21taskset12:29:342
365299130,2cyclictest20228-21diskmemload10:32:522
365299130,2cyclictest0-21swapper/212:04:002
365299130,2cyclictest0-21swapper/210:38:112
365299130,12cyclictest5515-21ssh10:46:112
365299130,12cyclictest0-21swapper/211:00:222
365299130,12cyclictest0-21swapper/210:25:032
365299130,11cyclictest0-21swapper/211:58:112
365299130,11cyclictest0-21swapper/211:25:252
365199131,1cyclictest0-21swapper/112:39:351
3651991310,2cyclictest3350-21kworker/u8:107:15:031
3651991310,2cyclictest20228-21diskmemload10:30:211
3651991310,2cyclictest0-21swapper/112:13:091
3651991310,2cyclictest0-21swapper/111:55:041
3651991310,2cyclictest0-21swapper/111:28:471
3651991310,2cyclictest0-21swapper/110:57:151
3651991310,2cyclictest0-21swapper/109:31:081
3651991310,2cyclictest0-21swapper/108:15:061
365199130,2cyclictest20228-21diskmemload12:15:021
365199130,2cyclictest20228-21diskmemload09:56:181
365199130,2cyclictest19645-21ssh12:20:131
365199130,2cyclictest19645-21ssh12:20:131
365199130,2cyclictest0-21swapper/111:40:071
365199130,2cyclictest0-21swapper/110:45:321
365199130,2cyclictest0-21swapper/110:35:241
365199130,2cyclictest0-21swapper/109:20:011
365199130,12cyclictest20228-21diskmemload09:40:141
365199130,12cyclictest0-21swapper/111:50:241
365199130,12cyclictest0-21swapper/108:40:141
365199130,11cyclictest8938-21runrttasks12:07:101
365199130,11cyclictest0-21swapper/110:40:371
365199130,11cyclictest0-21swapper/107:30:221
3650991310,2cyclictest20228-21diskmemload11:12:070
3650991310,2cyclictest20228-21diskmemload11:12:070
3650991310,2cyclictest20228-21diskmemload10:32:360
3650991310,2cyclictest0-21swapper/010:11:410
3650991310,2cyclictest0-21swapper/007:25:240
365099130,2cyclictest20228-21diskmemload11:52:350
365099130,2cyclictest0-21swapper/010:56:280
365099130,2cyclictest0-21swapper/010:20:540
365099130,2cyclictest0-21swapper/009:57:020
365099130,2cyclictest0-21swapper/009:53:340
365099130,2cyclictest0-21swapper/009:48:230
365099130,12cyclictest30746-21ssh09:20:460
365099130,12cyclictest20228-21diskmemload10:05:070
365099130,12cyclictest0-21swapper/011:42:560
365099130,12cyclictest0-21swapper/011:00:450
365099130,12cyclictest0-21swapper/010:27:450
365099130,12cyclictest0-21swapper/010:16:050
365099130,12cyclictest0-21swapper/008:50:160
365099130,12cyclictest0-21swapper/008:40:210
365099130,12cyclictest0-21swapper/008:25:160
365099130,11cyclictest0-21swapper/011:25:450
365099130,11cyclictest0-21swapper/010:35:230
306682130,2sleep20-21swapper/208:15:132
365399129,2cyclictest9565-21kworker/u8:207:44:043
365399120,1cyclictest7458-21runrttasks08:45:223
365399120,11cyclictest0-21swapper/312:15:393
365399120,11cyclictest0-21swapper/310:17:073
365299120,2cyclictest0-21swapper/211:44:082
365299120,11cyclictest0-21swapper/212:05:302
365299120,11cyclictest0-21swapper/211:52:142
365299120,11cyclictest0-21swapper/211:10:512
365299120,11cyclictest0-21swapper/211:10:512
365199129,2cyclictest9565-21kworker/u8:207:57:041
365199129,2cyclictest9565-21kworker/u8:207:38:041
365199129,2cyclictest9565-21kworker/u8:207:38:041
365199129,2cyclictest2143-21kworker/u8:208:38:041
365199129,2cyclictest10132-21kworker/u8:108:57:051
365199129,2cyclictest0-21swapper/109:05:181
365199129,2cyclictest0-21swapper/108:05:071
365199121,9cyclictest17658-21apt-get07:40:471
365199120,2cyclictest0-21swapper/109:00:181
365199120,2cyclictest0-21swapper/108:00:201
365099129,2cyclictest9565-21kworker/u8:207:41:050
365099129,2cyclictest18435-21munin-node0
365099120,2cyclictest0-21swapper/012:06:500
365099120,2cyclictest0-21swapper/007:20:170
365099120,11cyclictest0-21swapper/010:41:560
365099120,11cyclictest0-21swapper/008:55:220
365099120,11cyclictest0-21swapper/008:15:160
365099120,11cyclictest0-21swapper/007:30:210
312042120,2sleep220228-21diskmemload09:21:362
262232121,7sleep326235-21munin-run08:05:013
18792120,8sleep00-21swapper/008:25:010
112882120,2sleep20-21swapper/210:15:152
95792110,2sleep20-21swapper/207:21:162
365299118,2cyclictest301ktimersoftd/209:42:582
365299118,2cyclictest20228-21diskmemload09:36:302
365299118,2cyclictest17269-21kworker/u8:209:56:052
365299116,3cyclictest19535-21ssh09:45:562
365299110,10cyclictest20228-21diskmemload09:19:432
365299110,10cyclictest0-21swapper/210:01:272
365299110,10cyclictest0-21swapper/208:10:172
365199118,2cyclictest9565-21kworker/u8:207:25:041
365199110,9cyclictest0-21swapper/108:20:131
365099118,2cyclictest9565-21kworker/u8:208:14:040
365099118,2cyclictest6303-21kworker/u8:009:01:050
365099118,2cyclictest2568-21kworker/u8:007:16:040
365099112,3cyclictest277-21jbd2/sda1-807:55:000
365299107,2cyclictest6303-21kworker/u8:008:41:032
365299107,2cyclictest0-21swapper/209:50:172
365299106,2cyclictest1122-21pzem_voltage08:20:222
365299105,3cyclictest5827-21latency_hist07:15:002
365299104,2cyclictest6431-21nscd07:15:142
365299100,9cyclictest9565-21kworker/u8:208:02:042
365299100,9cyclictest20228-21diskmemload10:06:462
365299100,9cyclictest0-21swapper/210:12:152
365299100,2cyclictest0-21swapper/209:25:142
365199107,2cyclictest9565-21kworker/u8:208:10:041
365199107,2cyclictest0-21swapper/108:25:161
365199107,2cyclictest0-21swapper/107:20:121
365199101,2cyclictest4267-21diskstats07:10:161
365199100,8cyclictest0-21swapper/108:50:131
365099107,2cyclictest9565-21kworker/u8:207:45:040
365099107,2cyclictest3870-21apt-get07:10:140
365099107,2cyclictest0-21swapper/007:35:280
365099107,2cyclictest0-21swapper/007:35:280
365099103,3cyclictest6431-21nscd08:49:170
36539996,2cyclictest0-21swapper/308:25:273
36539994,3cyclictest7458-21runrttasks07:36:433
36539994,3cyclictest7458-21runrttasks07:36:433
36539994,3cyclictest20668-21cpuspeed_turbos07:50:113
36529996,2cyclictest9565-21kworker/u8:207:50:042
36529996,2cyclictest0-21swapper/209:00:342
36529995,3cyclictest5621-21seq08:31:132
36529994,3cyclictest6675-21snmpd09:05:152
36529994,3cyclictest6503-21df_abs08:35:132
36529994,3cyclictest27424-21ps08:05:192
36529994,3cyclictest15646-21seq07:36:002
36529994,3cyclictest15646-21seq07:36:002
36529994,3cyclictest14740-21df_abs08:55:142
36529994,3cyclictest12370-21tr07:30:152
36519995,3cyclictest4848-21ls08:30:161
36519990,8cyclictest0-21swapper/108:45:121
36509994,3cyclictest5498-21unixbench_singl08:30:250
36539985,2cyclictest9565-21kworker/u8:207:55:043
36539983,3cyclictest30581-21cut08:15:113
36529985,2cyclictest6303-21kworker/u8:008:50:042
36529984,3cyclictest18931-21gltestperf07:45:152
36529984,3cyclictest10444-21df_abs07:25:122
36529984,2cyclictest2318-21cpuspeed_turbos08:25:142
36529984,2cyclictest10767-21awk08:45:142
36529983,3cyclictest23922-21chrt07:56:252
36529973,2cyclictest0-21swapper/207:40:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional