You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-03-03 - 15:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sun Mar 03, 2024 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
171102119108,6sleep00-21swapper/007:07:420
17264210695,6sleep20-21swapper/207:09:412
17031210382,16sleep30-21swapper/307:06:413
15515210385,12sleep10-21swapper/107:05:111
131262720,0sleep30-21swapper/309:35:283
17317993315,16cyclictest7950-21ssh09:25:231
5502230,3sleep11731799cyclictest07:45:361
5502230,3sleep11731799cyclictest07:45:351
17316992117,2cyclictest0-21swapper/012:30:200
17318992017,2cyclictest920-21kworker/u8:209:13:042
17318992017,2cyclictest454-21kworker/u8:111:44:042
17318992017,2cyclictest15390-21kworker/u8:107:22:042
1731899200,15cyclictest0-21swapper/209:44:042
1731699200,2cyclictest0-21swapper/009:20:220
141962200,2sleep09-21ksoftirqd/012:05:520
17318991916,2cyclictest7287-21kworker/u8:209:22:042
17318991916,2cyclictest3480-21kworker/u8:009:26:042
17318991916,2cyclictest27784-21kworker/u8:008:56:042
17318991916,2cyclictest14548-21kworker/u8:210:10:042
304722180,0sleep20-21swapper/210:15:262
17319991815,2cyclictest5411-21kworker/u8:110:45:043
17318991815,2cyclictest7556-21kworker/u8:208:33:032
17318991815,2cyclictest5411-21kworker/u8:110:44:042
17318991815,2cyclictest454-21kworker/u8:111:45:042
17318991815,2cyclictest17637-21kworker/u8:211:12:032
17318991815,2cyclictest17030-21kworker/u8:108:42:042
17319991714,2cyclictest454-21kworker/u8:111:42:043
17318991714,2cyclictest7556-21kworker/u8:208:25:032
17318991714,2cyclictest7556-21kworker/u8:208:13:042
17318991714,2cyclictest4932-21kworker/u8:008:18:042
17318991714,2cyclictest454-21kworker/u8:111:52:042
17318991714,2cyclictest454-21kworker/u8:111:52:042
17318991714,2cyclictest29827-21kworker/u8:011:31:042
17318991714,2cyclictest27784-21kworker/u8:009:06:042
17318991714,2cyclictest27485-21kworker/u8:010:38:042
17318991714,2cyclictest26934-21kworker/u8:211:23:042
17318991714,2cyclictest18063-21kworker/u8:009:53:042
17318991714,2cyclictest15390-21kworker/u8:107:31:042
17318991714,2cyclictest14548-21kworker/u8:210:09:042
17318991714,2cyclictest1267-21kworker/u8:108:01:042
17319991613,2cyclictest15390-21kworker/u8:107:24:043
1731999161,13cyclictest15929-21df_abs08:25:233
17318991613,2cyclictest938-21kworker/u8:210:23:042
17318991613,2cyclictest7739-21kworker/u8:210:52:042
17318991613,2cyclictest7287-21kworker/u8:209:33:042
17318991613,2cyclictest3480-21kworker/u8:009:18:032
17318991613,2cyclictest29791-21kworker/u8:207:48:042
17318991613,2cyclictest29791-21kworker/u8:207:48:042
17318991613,2cyclictest19605-21kworker/u8:207:16:042
17318991613,2cyclictest18063-21kworker/u8:009:46:042
17318991613,2cyclictest17347-21kworker/u8:112:33:032
17318991613,2cyclictest15390-21kworker/u8:107:12:042
17318991613,2cyclictest11938-21kworker/u8:011:01:042
17318991613,2cyclictest11938-21kworker/u8:010:57:042
17318991613,2cyclictest10588-21kworker/u8:112:09:042
17316991611,3cyclictest0-21swapper/010:15:220
1731999151,3cyclictest0-21swapper/311:30:213
17319991512,2cyclictest7556-21kworker/u8:208:11:033
17319991512,2cyclictest4932-21kworker/u8:008:19:043
17319991512,2cyclictest29791-21kworker/u8:207:50:043
17319991512,2cyclictest29791-21kworker/u8:207:50:033
17319991512,2cyclictest27485-21kworker/u8:010:11:043
17319991512,2cyclictest26934-21kworker/u8:211:28:043
17319991512,2cyclictest23750-21kworker/u8:208:53:033
17319991512,2cyclictest23294-21kworker/u8:007:29:043
17319991512,2cyclictest19605-21kworker/u8:207:19:043
17319991512,2cyclictest18261-21kworker/u8:311:04:043
17319991512,2cyclictest18063-21kworker/u8:009:49:043
17319991512,2cyclictest14631-21kworker/u8:012:22:033
17319991512,2cyclictest0-21swapper/309:55:333
1731999151,12cyclictest7342-21munin-run08:05:003
1731999150,3cyclictest0-21swapper/309:30:003
1731899152,7cyclictest0-21swapper/208:55:002
1731899151,3cyclictest16289-21unixbench_multi12:10:382
17318991512,2cyclictest5365-21kworker/u8:012:00:042
17318991512,2cyclictest23750-21kworker/u8:209:02:042
17318991512,2cyclictest23294-21kworker/u8:007:36:042
17318991512,2cyclictest18261-21kworker/u8:311:06:042
17318991512,2cyclictest17347-21kworker/u8:112:20:032
17318991512,2cyclictest17030-21kworker/u8:108:48:042
17318991512,2cyclictest14548-21kworker/u8:210:01:042
1731899150,10cyclictest0-21swapper/212:39:042
17317991511,2cyclictest940-21apt-get07:50:051
17317991511,2cyclictest940-21apt-get07:50:051
17317991511,2cyclictest30155-21fschecks_time07:40:241
17319991411,2cyclictest5365-21kworker/u8:011:46:033
17319991411,2cyclictest26934-21kworker/u8:211:38:043
17319991410,2cyclictest23828-21munin-node3
1731999140,2cyclictest0-21swapper/312:35:303
1731999140,2cyclictest0-21swapper/308:30:223
1731999140,13cyclictest0-21swapper/310:00:333
17318991411,2cyclictest7885-21kworker/u8:211:55:032
17318991411,2cyclictest4932-21kworker/u8:008:20:042
17318991411,2cyclictest26934-21kworker/u8:211:26:042
17318991411,2cyclictest23294-21kworker/u8:007:28:042
1731899140,2cyclictest0-21swapper/211:18:042
1731899140,10cyclictest0-21swapper/207:51:042
1731899140,10cyclictest0-21swapper/207:51:042
17317991410,2cyclictest23933-21aten2.4_r3power12:30:211
17317991410,2cyclictest0-21swapper/109:50:321
1731799140,13cyclictest0-21swapper/110:25:231
1731799140,12cyclictest0-21swapper/112:12:551
1731699140,3cyclictest6188-21tr10:35:210
228462130,1sleep2301ktimersoftd/212:25:372
17319991310,2cyclictest7287-21kworker/u8:209:25:043
17319991310,2cyclictest5365-21kworker/u8:011:56:033
17319991310,2cyclictest3480-21kworker/u8:009:16:033
17319991310,2cyclictest29791-21kworker/u8:207:45:043
17319991310,2cyclictest29791-21kworker/u8:207:45:043
17319991310,2cyclictest27784-21kworker/u8:008:58:043
17319991310,2cyclictest17347-21kworker/u8:112:16:043
17319991310,2cyclictest17030-21kworker/u8:108:44:043
17319991310,2cyclictest15390-21kworker/u8:107:13:033
17319991310,2cyclictest0-21swapper/310:35:263
17319991310,2cyclictest0-21swapper/307:40:223
17319991310,2cyclictest0-21swapper/307:30:193
1731999130,2cyclictest0-21swapper/309:50:333
1731999130,12cyclictest0-21swapper/310:15:253
17318991310,2cyclictest10095-21copy10:45:012
1731899130,11cyclictest0-21swapper/207:40:312
1731799131,11cyclictest0-21swapper/109:20:251
17317991310,2cyclictest947-21diskmemload09:14:341
17317991310,2cyclictest0-21swapper/110:24:541
17317991310,2cyclictest0-21swapper/108:55:281
1731799130,2cyclictest0-21swapper/111:45:131
1731799130,12cyclictest0-21swapper/112:25:281
1731799130,12cyclictest0-21swapper/111:40:261
1731799130,12cyclictest0-21swapper/111:30:211
1731799130,12cyclictest0-21swapper/110:00:301
1731799130,12cyclictest0-21swapper/108:40:341
17316991310,2cyclictest0-21swapper/010:40:320
1731699130,3cyclictest0-21swapper/007:25:360
1731699130,2cyclictest0-21swapper/012:35:370
1731999129,2cyclictest7556-21kworker/u8:208:24:043
1731999129,2cyclictest23750-21kworker/u8:209:03:043
1731999129,2cyclictest21168-21kworker/u8:212:28:043
1731999129,2cyclictest17637-21kworker/u8:211:14:043
1731999129,2cyclictest15390-21kworker/u8:107:35:043
1731999129,2cyclictest0-21swapper/312:14:083
1731999129,2cyclictest0-21swapper/309:10:193
1731999129,2cyclictest0-21swapper/308:45:043
1731999120,2cyclictest0-21swapper/311:15:173
1731999120,1cyclictest0-21swapper/310:50:343
1731999120,11cyclictest0-21swapper/310:27:293
1731999120,11cyclictest0-21swapper/309:44:123
1731999120,10cyclictest0-21swapper/311:22:033
1731899129,2cyclictest7556-21kworker/u8:208:35:032
1731899127,3cyclictest0-21swapper/210:30:382
1731899122,7cyclictest0-21swapper/209:39:022
1731899120,2cyclictest0-21swapper/209:59:492
1731899120,2cyclictest0-21swapper/208:05:202
1731799129,2cyclictest0-21swapper/112:15:271
1731799129,2cyclictest0-21swapper/112:00:281
1731799129,2cyclictest0-21swapper/110:16:281
1731799129,2cyclictest0-21swapper/109:45:491
1731799129,2cyclictest0-21swapper/108:00:201
1731799120,11cyclictest7739-21kworker/u8:210:41:031
1731799120,11cyclictest0-21swapper/112:39:561
1731799120,11cyclictest0-21swapper/111:57:361
1731799120,11cyclictest0-21swapper/111:25:251
1731799120,11cyclictest0-21swapper/111:20:281
1731799120,11cyclictest0-21swapper/111:10:001
1731799120,11cyclictest0-21swapper/110:45:251
1731799120,11cyclictest0-21swapper/110:39:361
1731799120,11cyclictest0-21swapper/110:30:431
1731799120,11cyclictest0-21swapper/110:05:221
1731799120,11cyclictest0-21swapper/109:35:311
1731799120,11cyclictest0-21swapper/109:15:161
1731799120,11cyclictest0-21swapper/109:00:381
1731799120,11cyclictest0-21swapper/108:50:191
1731799120,11cyclictest0-21swapper/108:30:291
1731799120,11cyclictest0-21swapper/107:15:201
1731699129,2cyclictest0-21swapper/008:45:070
1731699121,9cyclictest24240-21switchtime10:00:380
1731699120,2cyclictest0-21swapper/010:45:060
1731699120,2cyclictest0-21swapper/007:20:320
1731699120,11cyclictest0-21swapper/011:45:220
1731699120,11cyclictest0-21swapper/011:05:390
1731699120,11cyclictest0-21swapper/008:30:200
1731999118,2cyclictest4932-21kworker/u8:008:06:043
1731999118,2cyclictest14548-21kworker/u8:210:06:033
1731999118,2cyclictest0-21swapper/311:50:233
1731999118,2cyclictest0-21swapper/311:50:233
1731999118,2cyclictest0-21swapper/311:06:233
1731999118,2cyclictest0-21swapper/310:55:203
1731999118,2cyclictest0-21swapper/310:30:253
1731999118,2cyclictest0-21swapper/310:24:593
1731999118,2cyclictest0-21swapper/309:20:273
1731999118,2cyclictest0-21swapper/309:05:333
1731999110,2cyclictest0-21swapper/312:02:153
1731999110,10cyclictest0-21swapper/310:42:163
1731899118,2cyclictest0-21swapper/212:15:302
1731899112,6cyclictest0-21swapper/210:30:002
1731899111,8cyclictest3385-21apt-get07:55:212
1731899110,9cyclictest31920-21munin-node2
1731799118,2cyclictest0-21swapper/111:50:081
1731799118,2cyclictest0-21swapper/111:50:081
1731799118,2cyclictest0-21swapper/111:37:331
1731799118,2cyclictest0-21swapper/111:05:261
1731799118,2cyclictest0-21swapper/110:10:031
1731799118,2cyclictest0-21swapper/109:55:321
1731799118,2cyclictest0-21swapper/109:42:181
1731799118,2cyclictest0-21swapper/108:25:301
1731799118,2cyclictest0-21swapper/107:35:161
1731799118,2cyclictest0-21swapper/107:20:181
1731799118,2cyclictest0-21swapper/107:10:191
1731699118,2cyclictest0-21swapper/011:15:250
1731699118,2cyclictest0-21swapper/011:10:280
1731699118,2cyclictest0-21swapper/010:30:210
1731699118,2cyclictest0-21swapper/007:35:160
1731699117,2cyclictest0-21swapper/008:05:000
1731699112,5cyclictest0-21swapper/011:40:010
1731699112,5cyclictest0-21swapper/009:58:460
1731699112,5cyclictest0-21swapper/008:00:010
1731699111,6cyclictest0-21swapper/011:50:010
1731699111,6cyclictest0-21swapper/011:50:000
1731699111,6cyclictest0-21swapper/011:30:000
1731699111,6cyclictest0-21swapper/008:55:210
1731699111,5cyclictest0-21swapper/007:45:000
1731699110,9cyclictest270-21jbd2/sda1-811:20:360
1731699110,2cyclictest0-21swapper/010:55:350
1731699110,2cyclictest0-21swapper/010:05:250
1731699110,2cyclictest0-21swapper/008:35:220
1731699110,10cyclictest0-21swapper/011:32:320
1731699110,10cyclictest0-21swapper/010:10:250
1731699110,10cyclictest0-21swapper/008:25:360
1731699110,10cyclictest0-21swapper/007:45:300
1731699110,10cyclictest0-21swapper/007:45:300
1731999107,2cyclictest29791-21kworker/u8:207:55:043
1731999105,3cyclictest13315-21smartctl12:05:213
1731799107,2cyclictest18261-21kworker/u8:311:03:041
1731799107,2cyclictest0-21swapper/110:55:241
1731799107,2cyclictest0-21swapper/108:10:201
1731799100,9cyclictest17030-21kworker/u8:108:47:031
1731799100,9cyclictest0-21swapper/112:20:131
1731799100,9cyclictest0-21swapper/110:51:171
1731799100,2cyclictest0-21swapper/112:06:481
1731699107,2cyclictest0-21swapper/010:20:210
1731699107,2cyclictest0-21swapper/008:10:220
1731699107,2cyclictest0-21swapper/008:05:260
1731699105,3cyclictest11997-21turbostat09:34:590
1731699101,5cyclictest0-21swapper/009:10:000
1731699101,4cyclictest0-21swapper/009:30:000
1731699100,9cyclictest0-21swapper/009:45:220
1731699100,2cyclictest0-21swapper/012:10:370
1731699100,2cyclictest0-21swapper/011:59:460
794290,2sleep00-21swapper/009:08:130
173199994,3cyclictest19664-21hostname08:35:193
173179996,2cyclictest4932-21kworker/u8:008:07:041
173179996,2cyclictest27784-21kworker/u8:009:07:031
173179996,2cyclictest0-21swapper/111:15:071
173179996,2cyclictest0-21swapper/107:25:251
173179994,3cyclictest27100-21seq07:31:571
173169996,2cyclictest0-21swapper/010:25:310
173169994,3cyclictest22033-21uniq12:25:250
173169994,3cyclictest13494-21sendmail_mailqu10:50:340
173169991,5cyclictest0-21swapper/012:20:010
173169991,5cyclictest0-21swapper/007:30:170
173169990,7cyclictest3314-21date07:55:010
173169990,7cyclictest3314-21date07:55:010
173169990,7cyclictest0-21swapper/012:20:190
173169990,3cyclictest14117-21ssh09:39:400
173169990,2cyclictest0-21swapper/012:02:200
173169990,2cyclictest0-21swapper/011:00:230
173179985,2cyclictest0-21swapper/108:35:341
173179984,3cyclictest12438-21ntpq08:15:271
173179983,3cyclictest3980-21hwlatdetect07:55:261
173179980,7cyclictest0-21swapper/109:31:411
173179980,2cyclictest0-21swapper/108:20:311
173169984,3cyclictest0-21swapper/008:20:210
173169984,2cyclictest17619-21aten2.4_r3power07:10:190
173169983,3cyclictest31987-21telnet11:35:210
173169983,3cyclictest21652-21head08:40:160
173169983,3cyclictest19956-21sort07:15:230
173169983,3cyclictest14708-21cpuspeed_turbos09:40:190
173169983,3cyclictest0-21swapper/009:00:220
173169981,6cyclictest0-21swapper/008:15:320
173169981,3cyclictest25602-21chrt08:50:060
173169980,7cyclictest0-21swapper/009:15:050
173169980,6cyclictest18726-21taskset09:50:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional