You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-30 - 19:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat Aug 30, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11281211289,16sleep30-21swapper/307:05:213
11794210785,17sleep00-21swapper/007:05:380
11829210695,6sleep20-21swapper/207:06:042
1182829680,11sleep10-21swapper/107:06:031
102132830,0sleep10-21swapper/112:08:241
10092790,0sleep00-21swapper/009:46:530
229222730,0sleep10-21swapper/109:35:441
298852720,0sleep20-21swapper/211:21:552
118172680,0sleep30-21swapper/311:04:123
89262250,0sleep30-21swapper/312:06:253
1216999232,19cyclictest20412-21ssh10:40:132
1216999231,2cyclictest0-21swapper/212:00:132
266942220,1sleep00-21swapper/009:05:010
1217199223,2cyclictest32478-21ssh11:58:013
230362210,1sleep30-21swapper/309:35:543
1216999212,2cyclictest0-21swapper/211:58:012
12169992118,2cyclictest11687-21kworker/u8:011:41:042
1216999210,16cyclictest0-21swapper/209:26:042
12165992116,3cyclictest28538-21diskmemload11:55:130
1216599210,2cyclictest0-21swapper/010:35:140
12169992017,2cyclictest11568-21kworker/u8:210:17:042
1216999200,10cyclictest26659-1kworker/u9:011:36:042
12167992014,5cyclictest0-21swapper/112:35:131
1216599200,18cyclictest0-21swapper/012:00:130
12171991916,2cyclictest5059-21kworker/u8:210:30:043
12171991916,2cyclictest4273-21kworker/u8:211:40:043
12171991916,2cyclictest17315-21kworker/u8:209:48:043
12171991916,2cyclictest15896-21kworker/u8:007:27:043
12171991916,2cyclictest11568-21kworker/u8:210:00:053
12171991916,2cyclictest11141-21kworker/u8:012:12:043
12171991815,2cyclictest4273-21kworker/u8:211:31:043
12171991815,2cyclictest4273-21kworker/u8:211:31:043
12171991815,2cyclictest3507-21kworker/u8:109:54:053
12171991815,2cyclictest27443-21kworker/u8:010:56:043
12171991815,2cyclictest23361-21kworker/u8:212:35:043
12171991815,2cyclictest17440-21kworker/u8:010:08:043
12171991815,2cyclictest10582-21kworker/u8:010:39:043
12169991815,2cyclictest15173-21kworker/u8:011:08:012
12169991815,2cyclictest10051-21kworker/u8:107:15:042
1216999180,16cyclictest0-21swapper/211:04:042
12171991714,2cyclictest4273-21kworker/u8:211:48:053
12171991714,2cyclictest32669-21kworker/u8:111:05:043
12171991714,2cyclictest17315-21kworker/u8:209:31:053
12171991714,2cyclictest12540-21kworker/u8:207:33:043
12171991714,2cyclictest11568-21kworker/u8:209:58:053
12169991714,2cyclictest6321-21kworker/u8:008:54:042
12169991714,2cyclictest27443-21kworker/u8:010:52:042
12169991714,2cyclictest26810-21kworker/u8:209:22:052
12169991714,2cyclictest26810-21kworker/u8:209:17:042
12169991714,2cyclictest23327-21kworker/u8:110:21:052
12169991714,2cyclictest22864-21kworker/u8:108:57:052
12169991714,2cyclictest12763-21kworker/u8:208:44:042
1216999170,12cyclictest0-21swapper/209:06:042
12167991713,2cyclictest21168-21date12:20:021
12165991712,3cyclictest0-21swapper/011:09:320
1217199161,3cyclictest2986-21ssh12:34:363
12171991613,2cyclictest6321-21kworker/u8:008:21:043
12171991613,2cyclictest5059-21kworker/u8:210:27:043
12171991613,2cyclictest32068-21kworker/u8:010:22:023
12171991613,2cyclictest29954-21kworker/u8:111:25:043
12171991613,2cyclictest29369-21kworker/u8:012:00:023
12171991613,2cyclictest27443-21kworker/u8:010:53:043
12171991613,2cyclictest26285-21kworker/u8:108:01:043
12171991613,2cyclictest22864-21kworker/u8:109:11:043
12171991613,2cyclictest22864-21kworker/u8:109:07:053
12171991613,2cyclictest20582-21kworker/u8:110:46:053
12171991613,2cyclictest17315-21kworker/u8:209:40:053
12171991613,2cyclictest12763-21kworker/u8:208:34:043
12171991613,2cyclictest11568-21kworker/u8:210:18:043
12171991613,2cyclictest11481-21kworker/u8:109:28:043
12171991613,2cyclictest11141-21kworker/u8:012:16:043
1217199161,13cyclictest0-21swapper/312:28:213
12169991613,2cyclictest5059-21kworker/u8:210:25:042
12169991613,2cyclictest30465-21kworker/u8:008:06:042
12169991613,2cyclictest26285-21kworker/u8:107:47:052
12169991613,2cyclictest23361-21kworker/u8:212:30:052
12169991613,2cyclictest23361-21kworker/u8:212:26:012
12169991613,2cyclictest15173-21kworker/u8:011:19:042
12169991613,2cyclictest15173-21kworker/u8:011:19:042
12169991613,2cyclictest12763-21kworker/u8:208:48:042
12169991613,2cyclictest12763-21kworker/u8:208:33:052
12169991613,2cyclictest12540-21kworker/u8:207:39:042
12169991613,2cyclictest11141-21kworker/u8:012:19:042
12169991613,2cyclictest10608-21kworker/u8:108:26:042
12169991613,2cyclictest10051-21kworker/u8:107:10:042
1216999160,2cyclictest0-21swapper/209:35:042
1216999160,15cyclictest0-21swapper/212:20:012
1216599161,13cyclictest19307-21cat11:45:010
1216599161,13cyclictest0-21swapper/011:39:080
203992150,0sleep00-21swapper/010:06:170
12171991512,2cyclictest4273-21kworker/u8:211:52:043
12171991512,2cyclictest4273-21kworker/u8:211:35:043
12171991512,2cyclictest32669-21kworker/u8:111:11:043
12171991512,2cyclictest26285-21kworker/u8:107:49:053
12171991512,2cyclictest15896-21kworker/u8:007:22:053
12171991512,2cyclictest15896-21kworker/u8:007:18:043
12171991512,2cyclictest15173-21kworker/u8:011:20:043
12171991512,2cyclictest12540-21kworker/u8:207:51:043
12171991512,2cyclictest10582-21kworker/u8:010:40:043
12169991512,2cyclictest6321-21kworker/u8:008:15:042
12169991512,2cyclictest6321-21kworker/u8:008:15:042
12169991512,2cyclictest5059-21kworker/u8:210:35:042
12169991512,2cyclictest4273-21kworker/u8:211:45:042
12169991512,2cyclictest32271-21kworker/u8:009:30:042
12169991512,2cyclictest27443-21kworker/u8:010:49:052
12169991512,2cyclictest26285-21kworker/u8:108:02:042
12169991512,2cyclictest22864-21kworker/u8:109:00:042
12169991512,2cyclictest17315-21kworker/u8:209:40:012
12169991512,2cyclictest12763-21kworker/u8:208:37:042
12169991511,2cyclictest9652-21ssh12:07:322
1216999150,2cyclictest0-21swapper/211:26:042
1216999150,2cyclictest0-21swapper/210:31:042
1216999150,10cyclictest0-21swapper/209:12:042
12167991512,2cyclictest29369-21kworker/u8:011:58:051
1216799150,2cyclictest5199-21tune2fs11:30:161
1216799150,2cyclictest5199-21tune2fs11:30:161
1216799150,13cyclictest0-21swapper/112:25:301
1216799150,13cyclictest0-21swapper/109:34:311
1216599151,12cyclictest3853-21diskstats09:50:160
12165991510,3cyclictest12709-21ssh09:59:320
1216599150,13cyclictest0-21swapper/009:05:150
12171991411,2cyclictest26285-21kworker/u8:108:11:053
12171991411,2cyclictest22493-21kworker/u8:211:17:043
12171991411,2cyclictest22493-21kworker/u8:211:17:043
12171991411,2cyclictest12763-21kworker/u8:208:35:043
1217199140,3cyclictest0-21swapper/309:15:213
1217199140,13cyclictest0-21swapper/308:25:133
12169991411,2cyclictest26285-21kworker/u8:107:44:042
12169991411,2cyclictest23327-21kworker/u8:110:14:012
12169991411,2cyclictest0-21swapper/210:55:022
1216999140,2cyclictest0-21swapper/211:13:052
1216999140,2cyclictest0-21swapper/210:05:222
1216999140,12cyclictest0-21swapper/209:45:132
1216799142,2cyclictest0-21swapper/111:24:011
1216799141,2cyclictest12586-21python09:25:251
12167991411,2cyclictest28538-21diskmemload12:30:111
12167991411,2cyclictest27215-21kworker/1:111:10:291
1216799140,2cyclictest0-21swapper/112:11:311
1216799140,2cyclictest0-21swapper/110:30:411
1216799140,2cyclictest0-21swapper/107:25:111
1216799140,12cyclictest28538-21diskmemload09:22:121
1216799140,12cyclictest20791-21df_abs10:40:151
1216799140,12cyclictest17902-21sh11:43:051
1216799140,12cyclictest0-21swapper/111:50:571
1216599142,7cyclictest29844-21ssh10:50:000
1216599140,2cyclictest0-21swapper/009:22:320
1216599140,12cyclictest17568-21ntp_states08:40:190
1216599140,12cyclictest16491-21ssh10:02:490
1216599140,12cyclictest12294-21hwlatdetect12:10:200
1216599140,12cyclictest0-21swapper/010:44:520
1216599140,12cyclictest0-21swapper/008:35:160
61442130,3sleep10-21swapper/112:04:401
192992131,9sleep019398-21wc08:45:190
12171991310,2cyclictest28538-21diskmemload10:10:453
12171991310,2cyclictest26810-21kworker/u8:209:21:043
12171991310,2cyclictest22864-21kworker/u8:109:03:043
1217199130,2cyclictest0-21swapper/312:24:443
1216999131,2cyclictest0-21swapper/212:13:042
12169991310,2cyclictest30465-21kworker/u8:007:57:042
12169991310,2cyclictest0-21swapper/209:55:492
1216999130,2cyclictest0-21swapper/211:50:532
1216999130,2cyclictest0-21swapper/209:51:042
1216799131,11cyclictest0-21swapper/109:12:411
12167991310,2cyclictest28538-21diskmemload10:17:211
12167991310,2cyclictest27443-21kworker/u8:010:55:041
12167991310,2cyclictest0-21swapper/112:24:421
12167991310,2cyclictest0-21swapper/111:38:471
12167991310,2cyclictest0-21swapper/110:07:211
12167991310,2cyclictest0-21swapper/109:50:261
12167991310,2cyclictest0-21swapper/109:46:241
12167991310,2cyclictest0-21swapper/109:16:511
12167991310,2cyclictest0-21swapper/108:50:121
12167991310,2cyclictest0-21swapper/108:35:161
12167991310,2cyclictest0-21swapper/107:10:281
1216799130,2cyclictest0-21swapper/109:00:261
1216799130,12cyclictest0-21swapper/109:56:081
1216799130,11cyclictest27616-21pzem_voltage07:45:241
1216599138,3cyclictest0-21swapper/007:50:180
1216599138,3cyclictest0-21swapper/007:20:000
1216599132,6cyclictest0-21swapper/008:30:000
12165991310,2cyclictest0-21swapper/012:35:520
12165991310,2cyclictest0-21swapper/010:56:420
1216599130,2cyclictest0-21swapper/011:02:430
1216599130,2cyclictest0-21swapper/010:15:170
1216599130,12cyclictest0-21swapper/010:10:230
1216599130,11cyclictest0-21swapper/012:20:510
1216599130,11cyclictest0-21swapper/009:10:140
1217199129,2cyclictest6321-21kworker/u8:008:53:043
1217199127,3cyclictest3590-21cat08:05:293
1217199120,2cyclictest0-21swapper/307:37:043
1217199120,1cyclictest0-21swapper/308:55:253
1217199120,10cyclictest0-21swapper/308:19:483
1217199120,10cyclictest0-21swapper/308:19:483
1216999129,2cyclictest6321-21kworker/u8:008:24:042
1216999129,2cyclictest3973-21kworker/u8:208:10:062
1216999129,2cyclictest0-21swapper/211:31:462
1216999129,2cyclictest0-21swapper/211:31:452
1216999120,2cyclictest0-21swapper/210:02:012
1216799129,2cyclictest28538-21diskmemload10:21:491
1216799129,2cyclictest15911-21diskstats10:35:161
1216799129,2cyclictest0-21swapper/111:05:061
1216799129,2cyclictest0-21swapper/110:45:041
1216799129,2cyclictest0-21swapper/108:40:011
1216799120,2cyclictest0-21swapper/111:47:051
1216799120,2cyclictest0-21swapper/110:00:261
1216799120,2cyclictest0-21swapper/108:55:181
1216799120,11cyclictest0-21swapper/111:25:581
1216799120,11cyclictest0-21swapper/111:01:401
1216799120,11cyclictest0-21swapper/110:51:181
1216799120,11cyclictest0-21swapper/110:26:471
1216799120,11cyclictest0-21swapper/110:10:511
1216799120,11cyclictest0-21swapper/109:40:151
1216799120,11cyclictest0-21swapper/107:55:161
1216799120,11cyclictest0-21swapper/107:20:211
1216799120,10cyclictest0-21swapper/111:15:221
1216799120,10cyclictest0-21swapper/111:15:221
1216799120,10cyclictest0-21swapper/108:00:211
1216599129,2cyclictest0-21swapper/012:27:220
1216599129,2cyclictest0-21swapper/012:16:260
1216599129,2cyclictest0-21swapper/012:07:120
1216599129,2cyclictest0-21swapper/011:51:210
1216599129,2cyclictest0-21swapper/011:31:000
1216599129,2cyclictest0-21swapper/011:31:000
1216599129,2cyclictest0-21swapper/011:25:100
1216599129,2cyclictest0-21swapper/011:20:280
1216599129,2cyclictest0-21swapper/010:32:330
1216599129,2cyclictest0-21swapper/010:26:580
1216599129,2cyclictest0-21swapper/009:15:210
1216599129,2cyclictest0-21swapper/007:25:180
1216599127,3cyclictest0-21swapper/007:50:000
1216599120,2cyclictest0-21swapper/011:17:040
1216599120,2cyclictest0-21swapper/011:17:040
1216599120,2cyclictest0-21swapper/010:20:160
1216599120,2cyclictest0-21swapper/009:30:010
1216599120,11cyclictest0-21swapper/012:30:460
1216599120,11cyclictest0-21swapper/011:47:500
1216599120,11cyclictest0-21swapper/010:53:010
1216599120,11cyclictest0-21swapper/009:40:210
1216599120,11cyclictest0-21swapper/009:25:250
1216599120,11cyclictest0-21swapper/007:10:000
1216599120,10cyclictest0-21swapper/007:43:040
123702110,2sleep30-21swapper/307:10:023
1217199118,2cyclictest12763-21kworker/u8:208:49:043
1216999118,2cyclictest0-21swapper/212:38:442
1216999118,2cyclictest0-21swapper/207:25:262
1216999113,6cyclictest0-21swapper/207:50:262
1216799117,2cyclictest0-21swapper/107:35:001
1216799110,10cyclictest0-21swapper/108:20:021
1216599110,2cyclictest0-21swapper/009:35:540
1216599110,1cyclictest0-21swapper/007:30:130
1216599110,10cyclictest0-21swapper/011:10:140
1216599110,10cyclictest0-21swapper/008:30:420
164482100,7sleep00-21swapper/007:20:120
1217199104,3cyclictest5129-21runrttasks07:40:503
1216999105,3cyclictest16818-21df_abs07:20:152
1216999100,2cyclictest0-21swapper/207:32:042
1216799107,2cyclictest0-21swapper/108:25:151
1216799106,2cyclictest24617-21basename07:40:131
1216799100,8cyclictest0-21swapper/108:10:241
1216799100,8cyclictest0-21swapper/107:50:141
1216799100,8cyclictest0-21swapper/107:35:141
1216799100,3cyclictest6539-21munin-node1
1216799100,3cyclictest6539-21munin-node1
1216799100,3cyclictest14418-21munin-node1
1216799100,2cyclictest0-21swapper/109:05:131
1216599107,2cyclictest0-21swapper/008:20:080
1216599105,3cyclictest7423-21grep08:15:190
1216599105,3cyclictest7423-21grep08:15:190
1216599105,3cyclictest31323-21tune2fs07:55:160
121719994,3cyclictest31721-21processes07:55:203
121719991,6cyclictest0-21swapper/308:40:253
121679996,2cyclictest0-21swapper/108:45:171
121659994,3cyclictest5129-21runrttasks08:53:340
121659994,3cyclictest5129-21runrttasks08:05:170
121659994,3cyclictest22913-21df_abs07:35:140
121659991,6cyclictest0-21swapper/008:58:030
121659991,6cyclictest0-21swapper/008:12:550
121659991,6cyclictest0-21swapper/008:02:520
121679985,2cyclictest0-21swapper/108:05:201
121679984,2cyclictest12635-21apt-get08:30:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional